-- Logs begin at Mon 2021-11-08 16:45:18 UTC, end at Mon 2021-11-08 18:20:23 UTC. -- Nov 08 17:30:04.979000 dv-cinder-816898-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 08 17:30:04.990843 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 8 17:30:04 2021] *** Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: nodename: dv-cinder-816898-2-iscsi Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: machine: x86_64 Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: clock source: unix Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: pcre jit disabled Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: detected number of CPU cores: 4 Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: current working directory: / Nov 08 17:30:04.992823 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: detected binary path: /usr/bin/uwsgi-core Nov 08 17:30:04.993441 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: your processes number limit is 47680 Nov 08 17:30:04.993441 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: your memory page size is 4096 bytes Nov 08 17:30:04.993441 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: detected max file descriptor number: 2048 Nov 08 17:30:04.993441 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: lock engine: pthread robust mutexes Nov 08 17:30:04.993441 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: thunder lock: enabled Nov 08 17:30:04.993441 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 08 17:30:04.993761 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 08 17:30:05.038365 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: Python main interpreter initialized at 0x561882cd29c0 Nov 08 17:30:05.038365 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: python threads support enabled Nov 08 17:30:05.038365 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: your server socket listen backlog is limited to 100 connections Nov 08 17:30:05.038365 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: your mercy for graceful operations on workers is 90 seconds Nov 08 17:30:05.038800 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: mapped 403077 bytes (393 KB) for 2 cores Nov 08 17:30:05.038800 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: *** Operational MODE: preforking *** Nov 08 17:30:05.039079 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: *** uWSGI is running in multiple interpreter mode *** Nov 08 17:30:05.039079 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: spawned uWSGI master process (pid: 101214) Nov 08 17:30:05.039273 dv-cinder-816898-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 08 17:30:05.042492 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: spawned uWSGI worker 1 (pid: 101253, cores: 1) Nov 08 17:30:05.042492 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: spawned uWSGI worker 2 (pid: 101254, cores: 1) Nov 08 17:30:05.042492 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 08 17:30:06.695407 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 17:30:06.695407 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: from cryptography.utils import int_from_bytes Nov 08 17:30:06.696107 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 17:30:06.696107 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: from cryptography.utils import int_from_bytes Nov 08 17:30:06.696107 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 17:30:06.696107 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: from cryptography.utils import int_from_bytes Nov 08 17:30:06.696720 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 17:30:06.696720 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: from cryptography.utils import int_from_bytes Nov 08 17:30:09.327651 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 17:30:09.328219 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 17:30:09.328319 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 17:30:09.328641 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 17:30:09.328889 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 17:30:09.329268 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.329590 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.329905 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.330219 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.330567 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.330875 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.331188 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.331501 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.331592 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 17:30:09.331950 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 17:30:09.332043 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.332043 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.332242 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 17:30:09.332363 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.332605 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 17:30:09.332698 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816898-2-iscsi {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.332859 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 17:30:09.332986 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.333241 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.333329 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.333567 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.333668 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.333879 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.333970 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.334179 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.334275 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.334520 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.334627 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.334827 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.334920 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.335149 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.335318 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.335753 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.335884 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.335999 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.336113 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.336226 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.336341 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.336455 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.336640 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816898-2-iscsi {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.336784 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.337498 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.337806 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.338085 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.338230 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.338355 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.338513 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.338639 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.338767 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.338901 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.339031 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.339145 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.339337 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.339471 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.339739 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816898-2-iscsi {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.339880 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.340055 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.340191 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.340366 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.340501 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.340677 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.340810 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.341038 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.341165 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.341352 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.341481 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.341659 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.341787 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.341976 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.342108 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.342281 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.342409 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.342623 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.342752 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.342930 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.343066 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.343253 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.343383 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816898-2-iscsi {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.343628 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.343765 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.343895 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.344024 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.344158 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.344293 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.344447 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.344618 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.344755 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.344930 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.345064 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.345269 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.345402 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.345536 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.345660 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.345856 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.345990 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.346159 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.346288 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.346492 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.346636 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.346812 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.346953 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.347127 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.347261 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.347399 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.347530 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.347663 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.347800 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.347924 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.348047 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.348207 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.348342 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.348511 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.348648 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.348814 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.348948 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.349113 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.349270 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.349403 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.349533 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.349704 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.349838 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.350003 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.350131 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.350303 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.350438 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.350632 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.350771 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.350900 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.351035 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.351168 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.351299 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.351436 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.351567 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.351738 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.351879 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.352044 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.352179 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.352351 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.352573 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.353291 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.353435 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.353571 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.353695 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.353879 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.354014 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.354188 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.354317 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.354513 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.354659 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.354823 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.354961 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.355146 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.355283 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.355460 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.355588 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.355779 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.355915 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.356084 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.356213 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.356398 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.356525 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.356726 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.356860 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.357024 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.357161 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.357285 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.357408 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.357553 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.357691 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.357852 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.357983 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.358165 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.358293 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.358479 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.358637 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.358826 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.358965 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.359091 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.359221 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.359344 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.359482 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.359641 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.359769 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.359941 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.360075 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.360241 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.360382 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.360542 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.360676 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.360843 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.360977 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.361141 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.361280 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.361442 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.361570 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.361741 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.361869 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.362038 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.362170 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.362341 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.362491 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.362672 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.362808 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.362974 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.363103 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.363273 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.363398 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.363574 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.363702 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.363875 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.364003 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.364180 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.364319 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.364479 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.364605 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.364781 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.364916 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.365084 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.365217 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.365381 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.365513 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.365680 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.365809 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.365990 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.366118 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.366291 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.366425 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.366673 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.366807 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.366932 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.367053 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.367197 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.367334 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.367497 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.367626 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.367807 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.367937 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.368148 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.368354 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.368554 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.368684 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.368815 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.368945 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.369069 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.369201 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.369333 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.369464 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.369599 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.369760 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.369888 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.370068 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.370230 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.370362 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.370510 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.370704 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.370825 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.371007 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.371137 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.371314 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.371441 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.371629 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.371758 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.371964 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.372101 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.372226 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.372335 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.372510 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.372648 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.373077 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.373205 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.373379 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.373514 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.373683 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.373823 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.373982 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.374110 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.374283 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.374410 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.374600 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.374735 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.374913 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.375041 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.375233 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.375360 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.375541 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.375678 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.375847 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.375976 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.376150 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.376282 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.376455 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.376584 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:30:09.376766 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.376901 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.377092 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.377267 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.377402 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.377527 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.377693 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.377821 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.378002 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.378136 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.378315 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.378444 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.378643 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.378771 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.378955 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.379092 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.379272 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.379408 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.379585 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.379725 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.379891 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.380019 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.380201 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.380337 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.380507 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.380635 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.380822 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.380942 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.381136 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.381265 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.381439 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.381573 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.381754 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.381894 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.382064 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.382193 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.382370 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.382539 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.382699 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.382846 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.383013 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.383143 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.383318 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.383452 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.383623 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.383764 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.383978 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.384106 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.384290 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.384602 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.384734 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.384905 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.385035 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.385208 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.385345 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.385509 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.385651 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.385811 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.385940 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.386111 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.386239 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.386426 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.386593 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.386771 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.386900 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.387077 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.387212 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.387406 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.387543 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.387711 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.387839 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.388019 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.388144 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.388324 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.388459 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.388626 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.388754 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.388933 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.389068 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.389237 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.389366 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.389538 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.389667 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.389840 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.389973 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.390148 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.390284 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.390446 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.390594 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.390788 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.390916 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.391090 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.391217 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.391390 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.391518 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.391699 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.391827 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.392010 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.392140 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.392314 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.392449 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.392621 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.392756 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.392926 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.393062 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.393233 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.393359 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.393539 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.393678 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.393843 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.393970 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.394166 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.394294 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.394502 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.394710 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.394839 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.394960 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.395105 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.395233 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.395413 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.395550 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.395709 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.395837 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.396015 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.396150 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.396314 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.396443 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.396614 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.396741 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.396912 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.397048 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.397217 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.397352 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.397517 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.397653 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.397815 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.397950 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.398112 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.398241 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.398409 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.398567 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.398731 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.398858 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.399047 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.399186 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.399880 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.400021 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.400184 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.400461 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.400591 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.400769 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.400896 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.401179 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.401327 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.401466 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.401590 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.401721 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.401843 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.402014 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.402144 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.402328 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.402513 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.402654 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.402779 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.402959 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.403088 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.403265 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.403392 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.403567 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.403693 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.403871 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.404005 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.404179 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.404316 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.404483 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.404619 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.404785 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.404921 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.405090 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.405217 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.405391 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.405525 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.405691 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.405835 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.406010 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.406138 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.406314 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.406453 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.406653 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.406791 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.406954 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.407083 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.407264 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.407392 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.407597 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.407726 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.407907 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.408034 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.408215 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.408352 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.408525 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.408662 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.408828 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.408954 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.409135 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.409262 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.409436 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.409570 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.409739 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.409873 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.410041 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.410169 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.410344 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.410532 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.410679 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.410805 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.410983 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.411112 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.411296 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.411425 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.411598 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.411724 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.411910 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.412051 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.412215 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.412354 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.412529 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.412658 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.412828 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.412965 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.413166 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.413298 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.413423 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.413552 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.413754 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.413892 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.414057 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.414193 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.414363 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.414523 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.414700 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.414838 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.415575 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.415726 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.415975 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.416102 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.416316 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.416444 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.416637 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.416774 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.416947 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.417077 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.417255 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.417389 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.417568 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.417702 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.417874 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.418008 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.418177 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.418305 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.418504 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.418634 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.418812 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.418941 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.419118 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.419248 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.419418 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.419547 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.419719 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.419857 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.420025 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.420154 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.420344 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.420473 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.420652 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.420788 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.420963 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.421091 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.421272 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.421393 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.421572 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.421711 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.421876 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.422006 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.422191 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.422317 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.422520 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.422663 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.422824 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.422950 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.423125 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.423253 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.423425 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.423562 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.423731 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.423858 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.424036 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.424165 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.424365 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.424492 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.424622 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.424746 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.424940 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.425074 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.425246 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.425375 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.425553 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.425681 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.425858 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.425994 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.426161 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.426291 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.426505 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.426636 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.426799 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.426925 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.427103 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.427243 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.427406 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.427540 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.427709 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.427844 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.428010 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.428137 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.428314 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.428433 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.428631 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.428763 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.428937 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.429066 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.429243 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.429373 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.429547 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.429684 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.429847 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.429975 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.430152 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.430287 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.430478 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.430645 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.430815 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.431139 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.431273 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.431455 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.431591 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.431763 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.431891 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.432073 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.432200 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.432383 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.432520 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.432693 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.432822 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.433003 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.433131 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.433326 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.433463 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.433634 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.433763 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.433943 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.434071 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.434251 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.434388 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.434584 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.434712 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.434890 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.435018 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.435197 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.435319 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.435500 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.435753 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.435882 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.436086 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.436224 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.436388 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.436522 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.436691 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.436826 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.436991 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.437128 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.437315 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.437441 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.437614 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.437752 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.437924 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.438053 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.438223 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.438352 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.438538 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.438666 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.438841 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.438969 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.439158 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.439286 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.439460 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.439593 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.439760 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.439902 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.440059 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.440195 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.440357 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.440486 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.440659 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.440799 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.440967 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.441095 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.441272 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.441401 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.441576 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.441714 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.441921 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.442050 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.442227 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.442368 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.442551 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.442680 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.442862 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.443066 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.443196 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.443319 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.443443 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.443565 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.443738 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.443867 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.444044 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.444172 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.444347 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.444484 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.444648 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.444777 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.444949 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.445076 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.445255 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.445389 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.445559 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.445688 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.445864 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.445999 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.446162 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.446321 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.446513 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.446646 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.446816 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.446945 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.447126 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.447265 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.447431 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.447565 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.447734 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.447863 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.448061 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.448190 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.448314 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.448438 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.448615 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.448743 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.448913 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.449043 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.449215 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.449352 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.449513 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.449642 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.449819 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.449946 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.450117 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.450251 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.450418 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.450580 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.450742 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.450872 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.451048 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.451175 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.451348 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.451476 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.451650 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.451780 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.451954 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.452082 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.452261 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.452403 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.452559 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.452694 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.452858 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.452987 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.453161 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.453304 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.453459 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.453589 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.453758 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.453888 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.454056 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.454191 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.454370 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.454549 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.454705 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.454844 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.455003 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.455139 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.455305 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.455439 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.455604 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.455730 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.455903 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.456033 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.456204 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.456332 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.456508 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.456636 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.456807 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.456936 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.457102 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.457230 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.457399 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.457539 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.457696 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.457826 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.457994 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.458122 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.458294 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.458429 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.458629 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.458756 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.458930 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.459062 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.459229 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.459366 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.459526 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.459656 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.459842 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.459969 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.460147 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.460286 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.460449 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.460577 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.460754 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.460884 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.461064 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.461204 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.461369 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.461497 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.461673 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.461795 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.462521 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.462667 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.462872 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.463096 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.463222 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.463344 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.463477 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.463603 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.463733 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.463858 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.464012 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.464142 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.464312 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.464442 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.464609 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.464747 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.464927 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.465057 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.465234 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.465364 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.465539 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.465668 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.465856 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.465993 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.466174 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.466304 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.466510 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.466640 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.466814 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.466958 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.467118 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.467254 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.467424 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.467560 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.467727 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.467864 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.468029 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.468165 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.468334 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.468463 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.468638 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.468775 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.468941 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.469067 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.469243 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.469370 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.469546 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.469683 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.469850 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.469986 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.470148 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.470314 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.470449 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.470622 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.470747 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.470870 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.471053 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.471182 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.471373 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.471510 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.471682 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.471818 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.471982 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.472119 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.472284 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.472422 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.472584 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.472713 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.472886 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.473015 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.473184 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.473319 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.473492 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.473619 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.473801 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.473938 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.474111 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.474258 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.474420 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.474572 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.474757 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.474903 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.475068 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.475205 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.475378 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.475508 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.475683 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.475820 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.475982 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.476110 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.476300 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.476427 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.476605 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.476809 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.476935 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.477059 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.477233 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.477366 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.478062 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.478314 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.478447 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.478627 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.478752 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.479044 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.479183 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.479345 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.479473 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.479646 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.479776 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.479947 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.480084 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.480265 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.480394 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.480565 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.480707 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.480879 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.481020 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.481198 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.481326 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.481506 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.481641 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.481868 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.481996 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.482225 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.482359 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.482560 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.482691 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.482874 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.483004 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.483180 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.483316 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.483484 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.483621 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.483796 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.483927 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.484094 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.484220 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.484404 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.484533 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.484710 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.484840 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.485010 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.485137 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.485334 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.485478 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.485637 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.485771 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.485946 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.486075 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.486244 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.486381 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.486585 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.486715 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.486905 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.487035 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.487213 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.487379 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.487530 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.487659 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.487936 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.488066 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.488254 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.488391 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.488558 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.488696 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.488874 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.489010 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.489176 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.489304 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.489485 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.489620 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.489784 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.489913 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.490088 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.490219 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.490388 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.490534 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.490711 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.490865 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.491030 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.491168 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.491331 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.491481 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.491641 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.491768 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.491947 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.492068 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.492252 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.492389 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.492552 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.492688 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.492850 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.492980 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.493272 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.493462 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.493636 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.493811 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.493946 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.494080 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.494205 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.494403 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.494587 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.494721 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.494906 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.495049 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.495208 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.495337 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.495525 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.495681 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.495830 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.495972 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.496128 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.496271 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.496426 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.496556 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.496723 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.496862 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.497059 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.497195 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.497357 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.497487 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.497671 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.498060 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.498236 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.498356 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.498586 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.498717 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.498894 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.499023 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.499217 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.499344 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.499531 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.499660 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.499839 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.499968 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.500152 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.500281 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.500454 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.500582 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.500759 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.500887 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.501058 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.501193 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.501358 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.501493 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.501660 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.501787 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.501961 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.502094 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.502258 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.502397 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.502584 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.502715 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.502884 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.503013 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.503182 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.503321 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.503478 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.503614 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.503792 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.503921 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.504090 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.504228 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.504405 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.504534 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.504705 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.504836 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.505001 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.505133 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.505299 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.505427 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.505595 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.505725 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.505929 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.506059 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.506225 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.506355 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.506575 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.506705 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.506882 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.507013 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.507188 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.507317 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.507496 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.507625 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.507798 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.507933 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.508098 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.508225 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.508400 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.508543 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.508730 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.508863 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.509040 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.509230 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.509350 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.509599 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.509729 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.509919 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.510049 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.510230 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.510358 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.510548 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.510684 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.510849 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.510984 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.511157 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.511292 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.511464 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.511601 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.511807 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.511978 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.512107 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.512299 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.512429 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.512607 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.512743 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.512914 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.513050 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.513220 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.513350 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.513526 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.513655 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.513833 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.513961 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.514153 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.514281 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.514413 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.514582 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.514742 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.514905 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.515044 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.515220 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.515350 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.515534 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.515663 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.515840 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.515970 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.516155 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.516284 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.516498 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.516638 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.516807 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.516933 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.517162 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.517296 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.517470 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.517599 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.517821 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.517953 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.518131 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.518260 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.518435 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.518613 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.518769 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.518898 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.519080 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.519209 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.519390 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.519529 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.519696 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.519824 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.520003 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.520137 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.520309 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.520444 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.520617 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.520747 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.520922 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.521050 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.521225 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.521355 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.521540 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.521668 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.521847 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.521975 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.522165 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.522295 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.522493 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.522625 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.522812 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.522954 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.523118 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.523245 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.523426 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.523555 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.523736 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.523941 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.524068 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.524248 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.524942 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.525098 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.525206 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.525405 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.525535 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.525728 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.525858 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.526050 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.526191 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.526363 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.526510 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.526698 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.526841 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.527007 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.527144 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.527312 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.527446 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.527616 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.527745 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.527921 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.528058 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.528262 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.528395 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.528528 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.528653 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.528826 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.528961 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.529130 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.529266 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.529430 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.529559 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.529742 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.529953 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.530083 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.530268 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.530585 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.530718 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.530930 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.531061 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.531245 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.531374 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.531559 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.531688 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.531887 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.532014 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.532183 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.532310 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.532486 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.532623 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.532792 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.532929 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.533096 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.533232 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.533398 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.533539 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.533699 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.533827 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.534001 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.534127 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.534302 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.534443 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.534626 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.534766 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.534935 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.535064 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.535239 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.535376 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.535538 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.535775 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.535904 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.536127 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.536265 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.536444 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.536571 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.536747 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.536876 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.537049 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.537187 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.537350 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.537478 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.537656 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.537792 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.537956 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.538094 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.538255 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.538391 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.538578 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.538708 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.538881 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.539020 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.539188 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.539319 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.539487 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.539607 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.539788 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.539926 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.540672 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.540805 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.540990 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.541118 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.541288 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.541416 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.541592 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.541748 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.541895 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.542024 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.542218 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.542353 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.542535 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.542658 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.542837 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.542978 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.543142 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.543270 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.543443 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.543572 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.543748 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.543884 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.544054 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.544183 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.544356 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.544483 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.544659 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.544796 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.544972 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.545109 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.545276 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.545502 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.545631 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.545878 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.546008 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.546185 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.546312 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.546516 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.546649 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.546824 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.546954 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.547130 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.547259 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.547455 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.547593 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.547755 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.547890 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.548054 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.548182 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.548366 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.548502 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.548672 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.548808 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.548978 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.549107 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.549283 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.549422 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.549587 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.549708 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.549892 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.550021 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.550195 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.550334 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.550518 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.550779 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.550920 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.551149 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.551286 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.551462 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.551591 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.551772 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.551902 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.552084 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.552222 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.552395 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.552525 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.552750 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.552890 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.553015 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.553148 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.553281 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.553411 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.553581 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.553711 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.553888 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.554017 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.554199 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.554333 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.554534 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.554663 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.554839 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.554969 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.555149 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.555275 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.555466 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.555615 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.556305 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.556436 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.556616 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.556752 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.556958 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.557096 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.557273 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.557417 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.557588 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.557715 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.557890 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.558027 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.558203 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.558333 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.558525 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.558669 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.558839 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.558976 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.559152 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.559280 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.559463 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.559592 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.559777 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.559915 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.560078 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.560206 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.560379 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.560516 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.560680 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.560810 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.560985 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.561113 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.561313 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.561442 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.561636 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.561763 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.561926 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.562055 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.562239 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.562368 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.562579 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.562711 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.562889 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.563024 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.563207 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.563324 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.563525 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.563632 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.563835 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.563933 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.564139 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.564248 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.564462 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.564558 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.564766 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.564868 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.565072 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.565187 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.565379 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.565481 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.565685 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.565787 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.565989 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.566092 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.566291 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.566387 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.566635 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.566732 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.566949 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.567036 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.567249 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.567334 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.567572 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.567665 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.567883 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.567970 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.568190 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.568274 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.568498 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.568581 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.568804 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.568901 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.569126 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.569224 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.569427 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.569521 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.569736 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.569840 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.570043 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.570149 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.570345 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.570448 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.570676 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.570763 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.570985 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.571072 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.571343 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.571968 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.572172 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.572268 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.572499 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.572585 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.572825 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.573018 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.573237 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.573389 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.573529 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.573676 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.573824 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.573964 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.574235 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.574387 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.574571 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.574715 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.574862 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.574999 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.575144 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.575282 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.575282 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 17:30:09.575551 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.575697 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.575874 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.576184 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.576498 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.576811 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.577136 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.577463 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.577833 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.578116 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.578478 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.578803 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.579147 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.579474 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.579786 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.580096 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.580402 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:30:09.580642 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 17:30:09.597801 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG oslo_db.sqlalchemy.engines [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:30:09.602562 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_db.sqlalchemy.engines [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:30:09.760834 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.context [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1542ebd2-db84-411d-aeb4-4e8d8b32d2fb(cell1) {{(pid=101254) load_cells /opt/stack/nova/nova/context.py:464}} Nov 08 17:30:09.765032 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG oslo_concurrency.lockutils [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:30:09.765840 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.context [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1542ebd2-db84-411d-aeb4-4e8d8b32d2fb(cell1) {{(pid=101253) load_cells /opt/stack/nova/nova/context.py:464}} Nov 08 17:30:09.766785 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG oslo_concurrency.lockutils [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:30:09.767590 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG oslo_concurrency.lockutils [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:30:09.769494 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG oslo_concurrency.lockutils [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:30:09.770007 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:30:09.771777 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:30:09.772580 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:30:09.774606 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:30:09.780237 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG oslo_db.sqlalchemy.engines [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:30:09.781065 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG oslo_db.sqlalchemy.engines [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:30:09.788209 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_db.sqlalchemy.engines [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:30:09.792718 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_db.sqlalchemy.engines [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:30:10.046709 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG oslo_db.sqlalchemy.engines [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:30:10.061998 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_db.sqlalchemy.engines [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:30:10.504147 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: WARNING keystonemiddleware.auth_token [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 17:30:10.512162 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: WARNING keystonemiddleware.auth_token [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 17:30:10.520890 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: WARNING keystonemiddleware.auth_token [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 17:30:10.528846 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: WARNING keystonemiddleware.auth_token [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 17:30:10.863190 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: WARNING keystonemiddleware.auth_token [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 17:30:10.869881 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: WARNING keystonemiddleware.auth_token [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 17:30:10.875307 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561882cd29c0 pid: 101254 (default app) Nov 08 17:30:10.876068 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: WARNING keystonemiddleware.auth_token [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 17:30:10.877384 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:30:10.878608 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Nov 08 17:30:10.879024 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Mon Nov 8 17:30:10 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:30:10.881207 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: WARNING keystonemiddleware.auth_token [None req-8eafb9d6-6250-4a22-80fb-67a13e467df6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 17:30:10.887088 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561882cd29c0 pid: 101253 (default app) Nov 08 17:31:35.423765 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:35.424766 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 08 17:31:35.425151 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:31:35.871048 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-60a82f82-762e-4aa4-9d6c-1e96caf4ea0d admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:35.900985 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-60a82f82-762e-4aa4-9d6c-1e96caf4ea0d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.466543 Nov 08 17:31:35.907663 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Mon Nov 8 17:31:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:31:38.249243 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:38.250223 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-0819a2a7-02cd-4235-b13e-978ace417de5 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Nov 08 17:31:38.250679 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:31:38.311876 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-2f1595de-f245-4e27-9bb1-ca743e3fdd13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "swap": 0, "disk": 1, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:38.330431 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:31:38.330431 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: warnings.warn(msg) Nov 08 17:31:38.430744 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-2f1595de-f245-4e27-9bb1-ca743e3fdd13 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.172584 Nov 08 17:31:38.431672 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:31:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:31:38.672986 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-8567f6e4-973c-4b34-b4e7-7a83468f66e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:38.675438 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:31:38.675438 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: warnings.warn(msg) Nov 08 17:31:38.805594 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-8567f6e4-973c-4b34-b4e7-7a83468f66e1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.364403 Nov 08 17:31:38.819564 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Nov 8 17:31:38 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:31:41.113412 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-2f1595de-f245-4e27-9bb1-ca743e3fdd13 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:41.114623 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-2f1595de-f245-4e27-9bb1-ca743e3fdd13 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Nov 08 17:31:41.115026 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:31:41.233572 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-9a90415a-ae72-4278-906e-5252b38be932 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "disk": 5, "swap": 0}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:41.253115 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:31:41.253115 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: warnings.warn(msg) Nov 08 17:31:41.339436 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-9a90415a-ae72-4278-906e-5252b38be932 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.216415 Nov 08 17:31:41.347330 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:31:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:31:41.353700 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-77d666ce-1f82-4722-8cc6-49fdda6d4188 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:41.355430 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:31:41.355430 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: warnings.warn(msg) Nov 08 17:31:41.480792 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-77d666ce-1f82-4722-8cc6-49fdda6d4188 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132031 Nov 08 17:31:41.481623 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Nov 8 17:31:41 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:31:43.827217 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-9a90415a-ae72-4278-906e-5252b38be932 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:43.828223 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-9a90415a-ae72-4278-906e-5252b38be932 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Nov 08 17:31:43.828631 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:31:43.890863 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-b9cbb1fd-afaa-4947-acca-c4630c6615a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "disk": 10, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:43.970404 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-b9cbb1fd-afaa-4947-acca-c4630c6615a1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135354 Nov 08 17:31:43.971158 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:31:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:31:43.985361 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-f40035cf-137d-4377-9999-3b511764c4e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:44.122006 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-f40035cf-137d-4377-9999-3b511764c4e5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140524 Nov 08 17:31:44.138779 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Nov 8 17:31:43 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:31:46.480404 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-b9cbb1fd-afaa-4947-acca-c4630c6615a1 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:46.481414 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-b9cbb1fd-afaa-4947-acca-c4630c6615a1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Nov 08 17:31:46.481811 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:31:46.540665 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-10ba9d12-22a2-475d-a755-0dc899ef9a9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:46.648477 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-10ba9d12-22a2-475d-a755-0dc899ef9a9d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160270 Nov 08 17:31:46.649084 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:31:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:31:46.661357 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-7ebffe58-06c7-4abf-a937-801b205f8dc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:46.733130 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-7ebffe58-06c7-4abf-a937-801b205f8dc2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075372 Nov 08 17:31:46.735685 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Nov 8 17:31:46 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:31:49.090940 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-10ba9d12-22a2-475d-a755-0dc899ef9a9d admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:49.091946 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-10ba9d12-22a2-475d-a755-0dc899ef9a9d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Nov 08 17:31:49.092613 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:31:49.160454 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-fbb660e0-0325-44f9-b434-b7b16c7aaff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:49.260317 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-fbb660e0-0325-44f9-b434-b7b16c7aaff1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161689 Nov 08 17:31:49.266605 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:31:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:31:49.274533 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-4ec91699-2f22-4d0a-9136-598500a306d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:49.394597 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-4ec91699-2f22-4d0a-9136-598500a306d3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124975 Nov 08 17:31:49.395164 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Mon Nov 8 17:31:49 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:31:51.920407 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-fbb660e0-0325-44f9-b434-b7b16c7aaff1 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:51.921434 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-fbb660e0-0325-44f9-b434-b7b16c7aaff1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Nov 08 17:31:51.921884 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:31:51.991702 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-1f565019-de41-4323-a08c-d374037d08d9 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:52.014608 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-1f565019-de41-4323-a08c-d374037d08d9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085921 Nov 08 17:31:52.015143 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Mon Nov 8 17:31:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:31:54.946169 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-fbb660e0-0325-44f9-b434-b7b16c7aaff1 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:54.947196 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-fbb660e0-0325-44f9-b434-b7b16c7aaff1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Nov 08 17:31:54.947599 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:31:55.012799 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-5e9ad391-1369-4f20-85f2-a3945e300247 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "disk": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:55.090230 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-5e9ad391-1369-4f20-85f2-a3945e300247 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.136149 Nov 08 17:31:55.090921 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:31:54 2021] POST /compute/v2.1/flavors => generated 402 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:31:55.107785 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-cd56f4b1-ce2a-49c3-86fd-1947aec3a25a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:55.199838 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-cd56f4b1-ce2a-49c3-86fd-1947aec3a25a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096557 Nov 08 17:31:55.200601 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Nov 8 17:31:55 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:31:57.769882 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-5e9ad391-1369-4f20-85f2-a3945e300247 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:31:57.771045 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-5e9ad391-1369-4f20-85f2-a3945e300247 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Nov 08 17:31:57.771531 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:31:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:31:57.830112 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-cc33c921-db07-453d-9643-a897ba0b5b47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:57.905401 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-cc33c921-db07-453d-9643-a897ba0b5b47 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.126218 Nov 08 17:31:57.906034 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:31:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:31:57.919150 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-ffc4f5c7-9c0a-46e6-8604-dce071df0f67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:31:58.017353 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-ffc4f5c7-9c0a-46e6-8604-dce071df0f67 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101934 Nov 08 17:31:58.017925 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Nov 8 17:31:57 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:32:00.327413 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-cc33c921-db07-453d-9643-a897ba0b5b47 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:00.329117 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-cc33c921-db07-453d-9643-a897ba0b5b47 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002139 Nov 08 17:32:00.337651 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:32:00 2021] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:00.395812 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-4bd83975-b53f-428d-b502-fe0447747e55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:00.488293 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-4bd83975-b53f-428d-b502-fe0447747e55 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.149420 Nov 08 17:32:00.488848 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:32:00 2021] POST /compute/v2.1/flavors => generated 406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:32:00.501971 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-0c9f8acc-4d64-4c7f-91fb-fe1319e14982 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:00.652454 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-0c9f8acc-4d64-4c7f-91fb-fe1319e14982 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153914 Nov 08 17:32:00.653082 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Nov 8 17:32:00 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:32:02.986483 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-4bd83975-b53f-428d-b502-fe0447747e55 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:03.001779 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-4bd83975-b53f-428d-b502-fe0447747e55 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Nov 08 17:32:03.001779 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:32:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:03.057772 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-c6e6c828-6e78-459d-8895-f68b356dd939 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:03.480408 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-c6e6c828-6e78-459d-8895-f68b356dd939 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484878 Nov 08 17:32:03.481001 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:32:02 2021] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:32:03.494140 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-fa972adb-6c30-472c-a494-16804fd37318 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:03.590701 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-fa972adb-6c30-472c-a494-16804fd37318 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100901 Nov 08 17:32:03.591599 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Nov 8 17:32:03 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:32:05.935913 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-c6e6c828-6e78-459d-8895-f68b356dd939 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:05.937279 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-c6e6c828-6e78-459d-8895-f68b356dd939 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001831 Nov 08 17:32:05.937993 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:32:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:06.002983 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-88459044-26bf-45bd-9661-c7b9d1d5eca5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "swap": 0, "name": "m1.xlarge", "disk": 160, "id": "5"}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:06.065015 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-88459044-26bf-45bd-9661-c7b9d1d5eca5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.120850 Nov 08 17:32:06.068887 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Mon Nov 8 17:32:05 2021] POST /compute/v2.1/flavors => generated 408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:32:06.078568 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-369bcc7c-0bfc-4401-962f-673ccb58c5c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:06.160875 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-369bcc7c-0bfc-4401-962f-673ccb58c5c5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086053 Nov 08 17:32:06.161461 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Mon Nov 8 17:32:06 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:32:45.103505 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-88459044-26bf-45bd-9661-c7b9d1d5eca5 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:45.104494 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-88459044-26bf-45bd-9661-c7b9d1d5eca5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 08 17:32:45.104894 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:32:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:45.161147 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-856bc4bf-bb56-41bb-82e4-bfb67a1becd6 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:45.178584 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-856bc4bf-bb56-41bb-82e4-bfb67a1becd6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067061 Nov 08 17:32:45.179114 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Mon Nov 8 17:32:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:32:46.728838 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-88459044-26bf-45bd-9661-c7b9d1d5eca5 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:46.729842 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-88459044-26bf-45bd-9661-c7b9d1d5eca5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Nov 08 17:32:46.730250 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:32:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:46.920486 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-0e879881-950e-4738-9f29-77ced5ee7ec4 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:46.925918 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.wsgi [None req-0e879881-950e-4738-9f29-77ced5ee7ec4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 08 17:32:46.926503 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-0e879881-950e-4738-9f29-77ced5ee7ec4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:32:46.927291 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-0e879881-950e-4738-9f29-77ced5ee7ec4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057843 Nov 08 17:32:46.927892 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Nov 8 17:32:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 17:32:46.937778 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-1fe5b491-321e-426b-a46a-75772dfd3c61 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:46.958680 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-1fe5b491-321e-426b-a46a-75772dfd3c61 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024556 Nov 08 17:32:46.959984 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Nov 8 17:32:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:32:46.970244 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-f70deecc-7220-456b-94bc-64150b124b92 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:46.991301 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-f70deecc-7220-456b-94bc-64150b124b92 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024375 Nov 08 17:32:46.991719 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Nov 8 17:32:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:32:47.007354 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-b73c67e6-4769-44de-921a-a5cf02815c6c admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:47.012877 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.wsgi [None req-b73c67e6-4769-44de-921a-a5cf02815c6c admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 08 17:32:47.013445 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-b73c67e6-4769-44de-921a-a5cf02815c6c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:32:47.014233 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-b73c67e6-4769-44de-921a-a5cf02815c6c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011186 Nov 08 17:32:47.014768 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Nov 8 17:32:47 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 17:32:48.437044 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-f70deecc-7220-456b-94bc-64150b124b92 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:48.438038 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-f70deecc-7220-456b-94bc-64150b124b92 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 08 17:32:48.438434 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:32:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:48.631894 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-ec4cc6db-0fdd-4516-8739-cb124ff0ec84 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:48.636981 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.wsgi [None req-ec4cc6db-0fdd-4516-8739-cb124ff0ec84 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 08 17:32:48.637537 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-ec4cc6db-0fdd-4516-8739-cb124ff0ec84 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:32:48.638322 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-ec4cc6db-0fdd-4516-8739-cb124ff0ec84 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058711 Nov 08 17:32:48.638860 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Nov 8 17:32:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 17:32:48.648813 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-3a37cf1b-e374-4804-8e87-847ef988da76 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:48.661730 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-3a37cf1b-e374-4804-8e87-847ef988da76 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016797 Nov 08 17:32:48.662963 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Nov 8 17:32:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:32:48.672631 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-be21a95b-bc32-492a-879e-5183b9195552 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:48.686600 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-be21a95b-bc32-492a-879e-5183b9195552 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017314 Nov 08 17:32:48.687120 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Nov 8 17:32:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:32:48.696701 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-02543898-e6d4-4500-9e59-89ff05ae2a46 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:48.701722 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.wsgi [None req-02543898-e6d4-4500-9e59-89ff05ae2a46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 08 17:32:48.702278 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-02543898-e6d4-4500-9e59-89ff05ae2a46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:32:48.703093 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-02543898-e6d4-4500-9e59-89ff05ae2a46 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010016 Nov 08 17:32:48.703571 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Mon Nov 8 17:32:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 08 17:32:50.119671 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-be21a95b-bc32-492a-879e-5183b9195552 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:50.120662 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-be21a95b-bc32-492a-879e-5183b9195552 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Nov 08 17:32:50.121302 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:32:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:50.308867 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-371156ae-f34d-49e3-80fe-2cad86d50a94 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:50.313966 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.wsgi [None req-371156ae-f34d-49e3-80fe-2cad86d50a94 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 08 17:32:50.314552 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-371156ae-f34d-49e3-80fe-2cad86d50a94 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:32:50.315329 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-371156ae-f34d-49e3-80fe-2cad86d50a94 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057069 Nov 08 17:32:50.315816 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Nov 8 17:32:50 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 17:32:50.325660 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-f97a9c10-5244-480e-83b0-2ed6228df559 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:50.339262 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-f97a9c10-5244-480e-83b0-2ed6228df559 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017101 Nov 08 17:32:50.339783 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Nov 8 17:32:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:32:50.350686 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:50.363389 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017216 Nov 08 17:32:50.363903 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Mon Nov 8 17:32:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:32:50.373544 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-1667074c-74a6-4ad0-878d-38b6a5efc940 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:50.378580 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.wsgi [None req-1667074c-74a6-4ad0-878d-38b6a5efc940 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 08 17:32:50.379126 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-1667074c-74a6-4ad0-878d-38b6a5efc940 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:32:50.379888 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-1667074c-74a6-4ad0-878d-38b6a5efc940 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010035 Nov 08 17:32:50.380362 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Nov 8 17:32:50 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 08 17:32:51.790687 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:51.791681 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 08 17:32:51.792070 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:32:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:51.981440 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-c4c977ce-b4d4-44ce-a561-c35d804f8ee1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:52.064693 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-c4c977ce-b4d4-44ce-a561-c35d804f8ee1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.133239 Nov 08 17:32:52.065169 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Nov 8 17:32:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:32:53.480955 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:53.481943 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Nov 08 17:32:53.482332 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:32:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:53.673272 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-70bc4010-838e-4be1-940c-1265995a2289 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:53.753292 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-70bc4010-838e-4be1-940c-1265995a2289 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.130629 Nov 08 17:32:53.753784 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Nov 8 17:32:53 2021] POST /compute/v2.1/flavors => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:32:55.171316 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:55.172299 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Nov 08 17:32:55.172693 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:32:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:55.365396 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-60278afe-bf13-4afc-a00a-e12f4370b59f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:55.453773 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-60278afe-bf13-4afc-a00a-e12f4370b59f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.140503 Nov 08 17:32:55.454311 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Nov 8 17:32:55 2021] POST /compute/v2.1/flavors => generated 407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:32:56.868275 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:56.869264 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 08 17:32:56.869660 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:32:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:57.065950 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-481bce13-cc62-49f9-83ba-ddcdd0b99f2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:32:57.172842 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-481bce13-cc62-49f9-83ba-ddcdd0b99f2e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.158211 Nov 08 17:32:57.173388 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Mon Nov 8 17:32:57 2021] POST /compute/v2.1/flavors => generated 409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:32:58.589030 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:58.590014 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Nov 08 17:32:58.591353 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:32:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:32:58.782644 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-c5f98d6c-8e41-4832-83ba-43df255f1d6a admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:32:58.801795 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-c5f98d6c-8e41-4832-83ba-43df255f1d6a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069458 Nov 08 17:32:58.802419 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Mon Nov 8 17:32:58 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:33:45.308819 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:33:45.309800 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-77c5d332-7054-4726-a8aa-a07811c87ce0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Nov 08 17:33:45.310195 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Mon Nov 8 17:33:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:33:45.371882 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-f91c39d1-13bf-43b1-843f-f716412ae117 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:33:45.390721 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-f91c39d1-13bf-43b1-843f-f716412ae117 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074142 Nov 08 17:33:45.391258 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Mon Nov 8 17:33:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:33:45.414047 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-3b4701a7-024f-4478-b06c-0ab8072f0e51 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:33:45.421683 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-3b4701a7-024f-4478-b06c-0ab8072f0e51 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011883 Nov 08 17:33:45.422212 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Mon Nov 8 17:33:45 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:33:45.435710 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-ca00bb55-5a16-49a5-8227-e9e726ceccc8 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:33:45.445065 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-ca00bb55-5a16-49a5-8227-e9e726ceccc8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013444 Nov 08 17:33:45.445611 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Mon Nov 8 17:33:45 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:33:45.458815 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-c882d4b7-8c92-4e21-853f-e8b9657d8498 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:33:45.467906 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-c882d4b7-8c92-4e21-853f-e8b9657d8498 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012713 Nov 08 17:33:45.468454 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Mon Nov 8 17:33:45 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:33:45.483060 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:33:45.491709 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012121 Nov 08 17:33:45.492301 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Mon Nov 8 17:33:45 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:35:17.789491 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-5e922f5c-b1a5-484e-a55f-b7b8d82bf944 tempest-verify_tempest_config-1363015694 tempest-verify_tempest_config-1363015694-project] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:35:17.791461 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-5e922f5c-b1a5-484e-a55f-b7b8d82bf944 tempest-verify_tempest_config-1363015694 tempest-verify_tempest_config-1363015694-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105551 Nov 08 17:35:17.791984 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1133 bytes} [Mon Nov 8 17:35:17 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:36:48.174231 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:36:48.175866 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 08 17:36:48.176321 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:36:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:36:48.427945 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-cfdad5d6-7acc-4748-a1e9-e34b7042a3cf admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:36:48.429089 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:36:48.429089 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: warnings.warn(msg) Nov 08 17:36:48.430681 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-cfdad5d6-7acc-4748-a1e9-e34b7042a3cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:36:48.431148 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-cfdad5d6-7acc-4748-a1e9-e34b7042a3cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:36:48.431962 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-cfdad5d6-7acc-4748-a1e9-e34b7042a3cf admin admin] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:36:48.432387 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-cfdad5d6-7acc-4748-a1e9-e34b7042a3cf admin admin] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:36:48.464069 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-cfdad5d6-7acc-4748-a1e9-e34b7042a3cf admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146480 Nov 08 17:36:48.464608 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 35/71] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Nov 8 17:36:48 2021] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:36:50.023776 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:36:50.024782 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 08 17:36:50.029490 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:36:50 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:36:50.225681 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-221b78d5-705d-4e4f-a133-36909ce45da0 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:36:50.226800 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:36:50.226800 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: warnings.warn(msg) Nov 08 17:36:50.228344 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-221b78d5-705d-4e4f-a133-36909ce45da0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:36:50.228780 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-221b78d5-705d-4e4f-a133-36909ce45da0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:36:50.229563 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-221b78d5-705d-4e4f-a133-36909ce45da0 admin admin] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:36:50.229982 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-221b78d5-705d-4e4f-a133-36909ce45da0 admin admin] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:36:50.255372 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-221b78d5-705d-4e4f-a133-36909ce45da0 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082443 Nov 08 17:36:50.255927 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 36/73] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Nov 8 17:36:50 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:37:02.136983 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:37:02.137976 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Nov 08 17:37:02.138369 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:37:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:37:02.331521 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-5e325351-1df3-4ce8-a601-48bed8780933 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:37:02.332673 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:37:02.332673 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: warnings.warn(msg) Nov 08 17:37:02.334305 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-5e325351-1df3-4ce8-a601-48bed8780933 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:37:02.334770 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-5e325351-1df3-4ce8-a601-48bed8780933 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:37:02.335558 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-5e325351-1df3-4ce8-a601-48bed8780933 admin admin] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:37:02.335982 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-5e325351-1df3-4ce8-a601-48bed8780933 admin admin] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:37:02.356580 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-5e325351-1df3-4ce8-a601-48bed8780933 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075956 Nov 08 17:37:02.357115 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 37/75] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Nov 8 17:37:02 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:37:03.807298 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: DEBUG nova.api.openstack.wsgi [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] Calling method '>' {{(pid=101254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:37:03.808327 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: INFO nova.api.openstack.requestlog [None req-a57b60f0-09bf-4331-a9be-b504f5448056 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 08 17:37:03.808717 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: [pid: 101254|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1074 bytes} [Mon Nov 8 17:37:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:37:04.003688 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG nova.api.openstack.wsgi [None req-01c7edf5-ff04-4cce-bbbb-c9c566d02166 admin admin] Calling method '>' {{(pid=101253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:37:04.004845 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:37:04.004845 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: warnings.warn(msg) Nov 08 17:37:04.006894 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-01c7edf5-ff04-4cce-bbbb-c9c566d02166 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:37:04.007343 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-01c7edf5-ff04-4cce-bbbb-c9c566d02166 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:37:04.008137 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-01c7edf5-ff04-4cce-bbbb-c9c566d02166 admin admin] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:37:04.008565 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: DEBUG oslo_concurrency.lockutils [None req-01c7edf5-ff04-4cce-bbbb-c9c566d02166 admin admin] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:37:04.029887 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: INFO nova.api.openstack.requestlog [None req-01c7edf5-ff04-4cce-bbbb-c9c566d02166 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080035 Nov 08 17:37:04.030380 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: [pid: 101253|app: 0|req: 38/77] 10.222.0.18 () {60 vars in 1193 bytes} [Mon Nov 8 17:37:03 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:38:03.828694 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: Mon Nov 8 17:38:03 2021 - graceful shutdown triggered... Nov 08 17:38:03.828840 dv-cinder-816898-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 08 17:38:03.829633 dv-cinder-816898-2-iscsi devstack@n-api.service[101253]: Gracefully killing worker 1 (pid: 101253)... Nov 08 17:38:03.830101 dv-cinder-816898-2-iscsi devstack@n-api.service[101254]: Gracefully killing worker 2 (pid: 101254)... Nov 08 17:38:04.828989 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: worker 1 buried after 1 seconds Nov 08 17:38:04.829541 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: worker 2 buried after 1 seconds Nov 08 17:38:04.829541 dv-cinder-816898-2-iscsi devstack@n-api.service[101214]: goodbye to uWSGI. Nov 08 17:38:04.830518 dv-cinder-816898-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 08 17:38:04.831067 dv-cinder-816898-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 08 17:38:04.833848 dv-cinder-816898-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 08 17:38:04.843330 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 8 17:38:04 2021] *** Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: nodename: dv-cinder-816898-2-iscsi Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: machine: x86_64 Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: clock source: unix Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: pcre jit disabled Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: detected number of CPU cores: 4 Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: current working directory: / Nov 08 17:38:04.845316 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: detected binary path: /usr/bin/uwsgi-core Nov 08 17:38:04.845965 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: your processes number limit is 47680 Nov 08 17:38:04.845965 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: your memory page size is 4096 bytes Nov 08 17:38:04.845965 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: detected max file descriptor number: 2048 Nov 08 17:38:04.845965 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: lock engine: pthread robust mutexes Nov 08 17:38:04.845965 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: thunder lock: enabled Nov 08 17:38:04.845965 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 08 17:38:04.845965 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 08 17:38:04.891709 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: Python main interpreter initialized at 0x55ccb7c979c0 Nov 08 17:38:04.891709 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: python threads support enabled Nov 08 17:38:04.891709 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: your server socket listen backlog is limited to 100 connections Nov 08 17:38:04.891709 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: your mercy for graceful operations on workers is 90 seconds Nov 08 17:38:04.892115 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: mapped 403077 bytes (393 KB) for 2 cores Nov 08 17:38:04.892204 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: *** Operational MODE: preforking *** Nov 08 17:38:04.892494 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: *** uWSGI is running in multiple interpreter mode *** Nov 08 17:38:04.892494 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: spawned uWSGI master process (pid: 127746) Nov 08 17:38:04.892686 dv-cinder-816898-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 08 17:38:04.894892 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: spawned uWSGI worker 1 (pid: 127762, cores: 1) Nov 08 17:38:04.894892 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: spawned uWSGI worker 2 (pid: 127763, cores: 1) Nov 08 17:38:04.894892 dv-cinder-816898-2-iscsi devstack@n-api.service[127746]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 08 17:38:06.728576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 17:38:06.728576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: from cryptography.utils import int_from_bytes Nov 08 17:38:06.729629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 17:38:06.729629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: from cryptography.utils import int_from_bytes Nov 08 17:38:06.763282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 17:38:06.763282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: from cryptography.utils import int_from_bytes Nov 08 17:38:06.763950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 08 17:38:06.763950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: from cryptography.utils import int_from_bytes Nov 08 17:38:09.336999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 17:38:09.337610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 17:38:09.337700 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 17:38:09.338016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 17:38:09.338273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 17:38:09.338693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.339019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.339345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.339665 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.339995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.340309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.340632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.340955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.341282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.341544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.341865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.342198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816898-2-iscsi {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.342546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.342862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.343174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.343501 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.343809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.344134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.344451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.344950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.346381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.346381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.346381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.346688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.347007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.347312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.347636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.347947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.348277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.348603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.349013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816898-2-iscsi {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.349340 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.350232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.350608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.351017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.351335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.351654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.351976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.352322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.352638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.352971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.353297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.353620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.353947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.354255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.354597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.354916 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.355243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.355556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.355862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.356117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.356429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.356754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.357076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.357401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.357658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.357909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.358233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.358581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.358897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.359211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.359525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.359834 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.360147 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.360458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.360770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.361084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.361764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.361764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.362033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.362543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.362879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.363297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.363555 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.363871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.364223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.364546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.364861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.365743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.366077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.366384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.366724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.367038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.367363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.367704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.368017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.368272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.368832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.369145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.369467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.369778 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.370089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.370399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.370731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.371044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.371357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.371667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.371984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.372295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.372604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.372913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.373225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.373534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.373862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.374188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.374525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.374837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.375147 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.375457 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.375793 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.376084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.376395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.376721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.377030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.377338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.377660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.377967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.378279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.378641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.378948 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.379264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.379590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.379893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.380203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.380509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.380846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.381156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.381465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.381775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.382089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.382393 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.382754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.383079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.383390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.383698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.384003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.384326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.384669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.385002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.385351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.385666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.386001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.386333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.386706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.387022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.387340 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.387674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.387992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.388303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.388639 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.388952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.389272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.389734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.389924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.390243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.390592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.390910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.391232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.391563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.391897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.392213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.392558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.392907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.393233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.393561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.393878 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.394203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.394575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.394893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.395210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.395586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.395868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.396184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.396682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.397165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.397495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.397813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.398128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.398442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.398788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.399101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.399429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.399890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.400076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.400419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.400730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.401048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.401364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.401677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.402009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.402412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.402664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.402993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.403410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.403613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.403945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.404255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.404630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.404886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.405201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.405533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.405833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.406160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.406503 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.406813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.407156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.407490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.407798 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.408126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.408455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.408777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.409086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.409401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.409711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.410103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.410326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.411127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.411127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.411463 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.411616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.411871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.412917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.413150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.413475 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.413775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.414082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.414392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.414774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.415079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.415429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.415772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.416100 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.416427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.416743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.417066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.417383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.417700 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.418018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.418334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.419512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.419512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.419512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.419944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.419944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.420488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.420889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.420889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.421190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.421467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.421804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.422112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.422443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.422783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.423112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.423412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.423992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.424165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.424316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.424642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.424957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.425276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.425592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.425917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.426231 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.426585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.426966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.427211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.427696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.428683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.429004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.429368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.429655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.429956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.430268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.430645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.430935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.431247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.431563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.431885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.432202 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.432521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.432831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.433508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.433508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.433898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.434116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.434395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.434747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.435058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.435355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.435624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.435932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.436345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.436563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.436877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.437186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.437499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.437806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.438211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.438489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.438803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.439123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.439448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.439761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.440081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.440395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.440708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.441031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.441347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.441658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.441970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.442281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.442622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.442936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.443291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.443604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.443915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.444229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.444533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.444844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.445164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.445750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.446083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.446400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.446749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.447073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.447393 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.447725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.448056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.448372 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.448681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.448992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.449300 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.449609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.449922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.450229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.450560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.450868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.451180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.451486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.451793 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.452144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.452456 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.452774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.453080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.453395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.453703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.454028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.454342 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.454678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.454986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.455292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.455636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.455947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.456285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.456616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.456961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.457268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.457579 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.457908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.458213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.458544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.458918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.459450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.460422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.460422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.460422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.460884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.461034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.461302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.461610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.461924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.462231 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.463692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.463692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.463692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.463692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.464281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.464281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.464570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.464733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.464959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.465280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.465589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.465897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.466206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.466558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.467633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.467633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.467633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.468105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.468105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.468428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.468668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.468973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.469518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.469614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.469889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.470209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.470548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.470854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.471159 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.471466 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.471773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.472084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.472389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.472701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.473004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.473309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.473614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.473939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.474251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.475131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.475444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.475808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.476287 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.476601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.476963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.477275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.477534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 08 17:38:09.477957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.478044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 08 17:38:09.478140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.478230 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.478319 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 08 17:38:09.478543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.478679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 08 17:38:09.478865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.478963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 08 17:38:09.479175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.479315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.479494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.479645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.479811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.479970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.480126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.480292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.480434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.480625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.480726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.480941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.481052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.481267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.481355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.481591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.481682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.481923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.482021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.482188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.482279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.482533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.482636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.482864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816898-2-iscsi {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.482961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.483193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.483290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.483505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.483602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.483816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.483906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.484131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.484234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.484437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.484525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.484747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.484834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.485057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.485154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.485370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.485562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.485678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.485875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.485970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.486186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.486284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.486521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.486613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.486864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.486965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.487183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.487272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.487495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.487583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.487816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.487914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.488124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.488214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.488436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.488526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.488744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.488843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.489058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.489154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816898-2-iscsi {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.489366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.489464 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.489756 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.489851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.490097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.490216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.491090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.491404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.491531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.491721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.491857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.492038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.492177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.492361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.492509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.492686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.492852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.492997 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.493169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.493417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.493772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.494000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.494095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.494314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.494411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.494656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.494750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.494965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.495053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.495274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.495372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.495586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.495683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.495912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.496001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.496220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.496320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.496527 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.496627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.496791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.496885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.497105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.497207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.497434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.497530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.497756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.497846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.498082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.498184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.498345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.498492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.498623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.498805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.498950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.499226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.499316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.499542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.499630 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.499860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.499968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.500178 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.500274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.500493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.500593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.500807 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.500904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.501111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.501263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.501420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.501516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.501732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.501867 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.502055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.502152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.502375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.502487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.502719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.502817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.503033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.503128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.503339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.503435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.503669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.503760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.503993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.504082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.504307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.504410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.504630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.504719 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.504963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.505059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.505278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.505377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.505603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.505716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.506019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.506351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.506520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.506688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.506847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.506992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.507164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.507299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.507481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.507607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.507811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.507907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.508154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.508251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.508473 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.508563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.508730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.508818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.509039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.509136 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.509353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.509445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.509677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.509765 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.509992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.510082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.510306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.510404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.510636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.510729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.510960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.511050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.511274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.511378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.511587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.511685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.511899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.512060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.512204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.512293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.512516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.512613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.512825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.512923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.513130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.513217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.513438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.513529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.513747 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.513848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.514071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.514161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.514380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.514496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.514724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.514825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.515036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.515134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.515347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.515436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.515659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.515750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.515985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.516072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.516296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.516388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.516608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.516697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.516927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.517065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.517237 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.517325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.517546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.517653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.517853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.517955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.518169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.518263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.518503 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.518607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.518800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.518899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.519107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.519196 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.519418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.519515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.519722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.519812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.520028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.520115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.520334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.520429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.520641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.520729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.520949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.521037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.521257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.521892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.522094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.522407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.522593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.522743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.522917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.523050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.523232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.523392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.523543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.523701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.523873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.524043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.524208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.524364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.524520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.524687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.524834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.525016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.525146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.525329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.525471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 08 17:38:09.525654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.525812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.525973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.526151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.526291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.526525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.526629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.526849 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.526939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.527190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.527309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.527527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.527625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.527852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.527943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.528165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.528253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.528484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.528572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.528800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.528963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.529119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.529217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.529439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.529666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.529768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.529996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.530094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.530312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.530401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.530653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.530745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.530968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.531065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.531285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.531376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.531600 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.531697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.531912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.532038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.532224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.532324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.532536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.532632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.532853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.532943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.533182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.533284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.533505 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.533596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.533832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.533920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.534170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.534274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.534509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.534615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.534831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.534922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.535151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.535293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.535468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.535568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.535785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.535874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.536106 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.536203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.536425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.536514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.536741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.536837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.537167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.537489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.537803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.538201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.538315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.538539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.538703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.538859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.539054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.539173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.539395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.539500 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.539722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.539816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.540046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.540289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.540387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.540484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.540681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.540772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.541000 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.541090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.541331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.541431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.541646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.541735 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.541965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.542062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.542305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.542504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.542647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.542822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.542970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.543154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.543289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.543482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.543602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.543807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.543921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.544127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.544234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.544444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.544534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.544770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.544868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.545078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.545186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.545383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.545480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.545694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.545792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.546006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.546097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.546313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.546402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.546678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.546768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.546996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.547087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.547305 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.547440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.547619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.547711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.547931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.548021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.548251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.548464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.548561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.548816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.548914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.549136 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.549225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.549466 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.549554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.549795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.549894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.550117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.550209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.550430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.550583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.550762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.550859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.551077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.551174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.551386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.551476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.551693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.551789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.552000 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.552090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.552306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.552409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.553174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.553272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.553485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.553655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.553793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.553977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.554100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.554288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.554406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.554650 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.554742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.554962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.555061 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.555294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.555384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.555605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.555701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.555914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.556005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.556223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.556321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.556539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.556639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.556850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.556939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.557157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.557245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.557464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.557601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.557771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.557905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.558084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.558173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.558390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.558518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.558730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.558828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.559037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.559126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.559349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.559447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.559655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.559743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.559967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.560046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.560272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.560375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.560589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.560677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.560893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.560982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.561200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.561290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.561510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.561605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.561822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.561911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.562125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.562214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.562442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.562608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.562779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.562868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.563120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.563218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.563437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.563526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.563758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.563968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.564068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.564353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.564451 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.564667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.564755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.564978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.565249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.565345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.565584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.565671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.565894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.565993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.566202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.566289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.566534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.566625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.566847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.566955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.567167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.567263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.567472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.567567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.567787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.567887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.568089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.568196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.568944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.569039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.569261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.569374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.569574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.569710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.569887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.570165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.570268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.570507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.570600 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.570837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.570935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.571150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.571255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.571461 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.571550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.571774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.571862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.572080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.572179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.572510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.572649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.572768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.572865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.572998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.573089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.573307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.573403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.573619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.573708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.573923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.574154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.574258 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.574352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.574558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.574699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.574865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.574983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.575167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.575260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.575474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.575577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.575793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.575889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.576101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.576198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.576420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.576524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.576736 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.576833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.577039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.577145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.577341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.577437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.577661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.577750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.577970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.578071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.578275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.578373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.578600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.578706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.578908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.579007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.579249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.579338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.579559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.579649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.579860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.579957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.580174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.580263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.580494 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.580590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.580803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.580894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.581114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.581207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.581425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.581515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.581732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.581830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.582049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.582138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.582361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.582482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.582694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.582795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.583002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.583102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.583308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.583403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.583615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.583705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.583957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.584060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.584369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.584561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.584656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.584739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.584946 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.585046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.585261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.585361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.585590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.585688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.585919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.586011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.586227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.586397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.586582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.586820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.586909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.587200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.587307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.587469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.587560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.587788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.587885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.588108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.588215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.588425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.588514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.588739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.588827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.589050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.589149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.589363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.589453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.589664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.589752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.589974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.590077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.590279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.590377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.590605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.590697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.590916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.591008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.591220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.591316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.591525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.591687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.591829 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.591927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.592137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.592235 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.592439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.592528 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.592741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.592839 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.593089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.593177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.593392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.593481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.593666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 17:38:09.593764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.593993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.594304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.594629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.594951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.595262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.595565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.595870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.596172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.596513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.596817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.597149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.597475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.597812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.598116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.598420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.598763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.599071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.599373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.599675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.599982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.600291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.600593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.600901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.601208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.601516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.601822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.602122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.602428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.602754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.603067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.603374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.603675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.603974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.604282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.604590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.604891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.605200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.605499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.605813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.606115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.606416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.606742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.607052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.607359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.607660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.607981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.608290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.608591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.608894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.609207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.609509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.609811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.610118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.610437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.610774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.611079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.611389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.611692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.611995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.612299 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.612626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.612905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.613207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.614331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.614331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.614331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.614612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.614747 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.615026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.615830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.616141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.616476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.616773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.617133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.617471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.617788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.618109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.618423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_db.sqlalchemy.engines [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:38:09.619044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.619044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.619317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.619624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.619938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.620250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.620566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.620870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.621180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.621500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.621814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.622171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.623047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.623047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.623377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.623475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.623723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.624048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.624331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.624641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.624950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.625260 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.625569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.625877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.626198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.626514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.626824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.627133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.627492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.627741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.628062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.628378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.628667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.629001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.629280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.629588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.629890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.630320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.631354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.631561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.631867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.632285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.633086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.633086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.633282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.633509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.633925 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.634239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.634573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.634886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.635193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.635487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.635796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.636120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.636424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.636733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.637035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.637356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.637659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.637976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.638392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.638729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.639038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.639453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.639763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.640074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.640394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.640713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.641035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.641354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.641648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.641956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.642275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.642621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.642933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.643247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.643553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.643877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.644200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.644514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.644835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.645245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.645565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.645874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.646195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.646582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.647028 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.647342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.647707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.647956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.648264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.648586 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.648892 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.649208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.649525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.649823 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.650127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.650430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.650773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.651091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.651391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.651703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.652023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.652343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.652647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.652966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.653274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.653577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.653880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.654184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.654550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.654856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.655177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.655505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.655832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.656143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.656475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.656798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.657112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.657428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.657817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.658049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.658406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.658679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.658984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.659289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.659732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.659894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.660193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.660495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.660798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.661193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.661413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.661732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.662275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.662770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.663084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.663390 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.663733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.664040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.664374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.664694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.665014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.665341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.665652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.665973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.666289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.666632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.666949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.667266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.667580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.667922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.668203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.668512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.668826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.669138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.669458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.670009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.670336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.670676 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.670992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.671302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.671612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.671923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.672233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.672544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.672853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.673165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.673490 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.673810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.674133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.674504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.674803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.675117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.675432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.675744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.676099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.676413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.676718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.677031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.677348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.678186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.678514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.678858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.679274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.679591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.680038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.680216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.680528 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.680841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.681166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.681498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.681819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.682130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.682444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.682780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.683298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.683617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.683951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.684669 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.684669 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.684934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.685203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.685529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.685834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.685969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.context [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1542ebd2-db84-411d-aeb4-4e8d8b32d2fb(cell1) {{(pid=127762) load_cells /opt/stack/nova/nova/context.py:464}} Nov 08 17:38:09.686138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.686447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.686778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.687083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.687426 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.687714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.688021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.688751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.688751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.689157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.689501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.689821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.690197 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:09.690347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.690513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.690786 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.691094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.691531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.691681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:09.691826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.692011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.692326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.692467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:09.692637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.692941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.693853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.694260 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.694599 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.694908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.695134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:09.695270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.695512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.695837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.696142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.696445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.696748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.697059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.697363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.697654 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.697961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.698592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.698905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.699210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.699522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.699830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.700142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.700540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.700742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.701044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.701365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.701671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.701972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.702288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.702621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.702943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.703255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.703568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.703924 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.704244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.704805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.705183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.705405 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_db.sqlalchemy.engines [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:38:09.705520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.706098 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.706441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.706754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_db.sqlalchemy.engines [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:38:09.707042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.707169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.708990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.708990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.708990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.708990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.708990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.708990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.711313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.711313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.711313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.711313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.711313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.711313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.711313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.712658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.712658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.712658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.712658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.712658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.713413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.713413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.713678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.713820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.714078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.714405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.714829 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.715218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.715456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.715776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.716084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.716402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.716721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.717031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.717352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.717662 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.717990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.718328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.718677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.719005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.719298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.719607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.719911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.720221 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.720550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.720863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.721194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.721481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.721886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.722098 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.722416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.722757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.723076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.723385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.723716 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.724025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.724336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.724680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.724982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.725291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.725600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.725924 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.726245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.726570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.726893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.727208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.727524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.727839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.728147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.728472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.728780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.729081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.729387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.729696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.730008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.730739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.730739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.731026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.731282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.731605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.731977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.732255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.732594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.732918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.733233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.733542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.733843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 08 17:38:09.734082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 08 17:38:09.757844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:38:09.825468 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.context [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1542ebd2-db84-411d-aeb4-4e8d8b32d2fb(cell1) {{(pid=127763) load_cells /opt/stack/nova/nova/context.py:464}} Nov 08 17:38:09.829724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:09.831316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:09.832134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:09.834362 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:09.846632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:38:09.847378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:38:09.965883 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_db.sqlalchemy.engines [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:38:10.112818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 08 17:38:10.291968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: WARNING keystonemiddleware.auth_token [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 17:38:10.299522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: WARNING keystonemiddleware.auth_token [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 17:38:10.442003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: WARNING keystonemiddleware.auth_token [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 17:38:10.450787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: WARNING keystonemiddleware.auth_token [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 17:38:10.643376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: WARNING keystonemiddleware.auth_token [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 17:38:10.650450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: WARNING keystonemiddleware.auth_token [None req-059f9b23-7568-4912-90c2-b1cf9173d83c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 17:38:10.655768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ccb7c979c0 pid: 127762 (default app) Nov 08 17:38:10.797734 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: WARNING keystonemiddleware.auth_token [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 08 17:38:10.802881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: WARNING keystonemiddleware.auth_token [None req-1a4d6401-6e79-4c97-b7ce-eb19ad1fec91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 08 17:38:10.808953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ccb7c979c0 pid: 127763 (default app) Nov 08 17:38:45.738851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b6feb3f7-1d90-4419-93b7-75faf654cc6d tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Action: 'create', calling method: .version_select at 0x7f06ed27c280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1251467823"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:45.770733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-071b45e6-fce7-49c2-bfc7-5863e019e809 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Action: 'create', calling method: .version_select at 0x7f06ed27b280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2040742993", "metadata": {"Type": "work"}}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:45.774397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-071b45e6-fce7-49c2-bfc7-5863e019e809 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:38:45.776073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-071b45e6-fce7-49c2-bfc7-5863e019e809 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.564711 Nov 08 17:38:45.777571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Nov 8 17:38:44 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1569 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 08 17:38:45.787353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0e1b4a60-6b4e-43be-a3e8-8a8e00c3f108 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Action: 'create', calling method: .version_select at 0x7f06ed27be50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-514214874", "metadata": {"Type": "work"}}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:45.789252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0e1b4a60-6b4e-43be-a3e8-8a8e00c3f108 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:38:45.790477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0e1b4a60-6b4e-43be-a3e8-8a8e00c3f108 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007488 Nov 08 17:38:45.791531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 2/2] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Nov 8 17:38:45 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 08 17:38:45.803879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8687545a-4b88-4129-894e-f5e869726415 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Action: 'create', calling method: .version_select at 0x7f06ed27bdc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1840947364", "metadata": {"Type": "work"}}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:45.805463 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8687545a-4b88-4129-894e-f5e869726415 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:38:45.806921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8687545a-4b88-4129-894e-f5e869726415 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009488 Nov 08 17:38:45.808087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 3/3] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Nov 8 17:38:45 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 08 17:38:45.827390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c119dc77-98bb-4a76-ae3e-8348f90ed1e7 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Calling method '.version_select at 0x7f06ed1728b0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:46.374897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-c119dc77-98bb-4a76-ae3e-8348f90ed1e7 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] HTTP exception thrown: Volume tempest-invalid-185444700 could not be found. Nov 08 17:38:46.375637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c119dc77-98bb-4a76-ae3e-8348f90ed1e7 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Returning 404 to user: Volume tempest-invalid-185444700 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:38:46.376574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c119dc77-98bb-4a76-ae3e-8348f90ed1e7 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-185444700" status: 404 len: 98 microversion: 2.1 time: 0.558359 Nov 08 17:38:46.377787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 4/4] 10.222.0.18 () {58 vars in 1214 bytes} [Mon Nov 8 17:38:45 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-185444700 => generated 98 bytes in 561 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 08 17:38:46.387827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-27c4ad9c-7468-4e21-915c-4c412affee18 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003923 Nov 08 17:38:46.388352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 5/5] 10.222.0.18 () {58 vars in 1139 bytes} [Mon Nov 8 17:38:46 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 08 17:38:46.402575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2258c128-c3b8-4227-91e0-bb252387364e tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007698 Nov 08 17:38:46.402575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 6/6] 10.222.0.18 () {58 vars in 1136 bytes} [Mon Nov 8 17:38:46 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 08 17:38:46.423529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ca2a1750-9dd1-4ff1-b5a0-582afe730bd6 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Calling method '.version_select at 0x7f06ed0ccee0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:46.958433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-ca2a1750-9dd1-4ff1-b5a0-582afe730bd6 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] HTTP exception thrown: Volume 13eb4d47-a18d-4e58-98fc-697035a196b6 could not be found. Nov 08 17:38:46.958433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ca2a1750-9dd1-4ff1-b5a0-582afe730bd6 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Returning 404 to user: Volume 13eb4d47-a18d-4e58-98fc-697035a196b6 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:38:46.958433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ca2a1750-9dd1-4ff1-b5a0-582afe730bd6 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/13eb4d47-a18d-4e58-98fc-697035a196b6" status: 404 len: 109 microversion: 2.1 time: 0.496188 Nov 08 17:38:46.958433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 7/7] 10.222.0.18 () {58 vars in 1247 bytes} [Mon Nov 8 17:38:46 2021] DELETE /compute/v2.1/os-volumes/13eb4d47-a18d-4e58-98fc-697035a196b6 => generated 109 bytes in 497 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:38:47.152558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1584935065", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "networks": [{"uuid": "272200e8-ed26-4aab-b66c-e354007e6c34"}]}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:47.302508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.network.neutron [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] validate_networks() for [('272200e8-ed26-4aab-b66c-e354007e6c34', None, None, None, None, None)] {{(pid=127762) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:38:47.836703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b6feb3f7-1d90-4419-93b7-75faf654cc6d tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.415972 Nov 08 17:38:47.845236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1/8] 10.222.0.18 () {60 vars in 1154 bytes} [Mon Nov 8 17:38:44 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3426 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 08 17:38:47.852327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-628a21a6-fe33-48e6-99f6-9b8cf15dd731 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Calling method '.version_select at 0x7f06ed130e50>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:47.913512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-628a21a6-fe33-48e6-99f6-9b8cf15dd731 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] HTTP exception thrown: Volume d7d5f858-7262-4490-abe0-862cd07c007e could not be found. Nov 08 17:38:47.914276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-628a21a6-fe33-48e6-99f6-9b8cf15dd731 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] Returning 404 to user: Volume d7d5f858-7262-4490-abe0-862cd07c007e could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:38:47.915336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-628a21a6-fe33-48e6-99f6-9b8cf15dd731 tempest-VolumesNegativeTest-1756786168 tempest-VolumesNegativeTest-1756786168-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d7d5f858-7262-4490-abe0-862cd07c007e" status: 404 len: 109 microversion: 2.1 time: 0.068654 Nov 08 17:38:47.916174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 2/9] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:38:47 2021] GET /compute/v2.1/os-volumes/d7d5f858-7262-4490-abe0-862cd07c007e => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:38:47.920817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-662c9614-3b3f-4cde-afc4-df7b9f3a7155 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ed0d6550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:48.029602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-662c9614-3b3f-4cde-afc4-df7b9f3a7155 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 200 len: 345 microversion: 2.1 time: 0.112138 Nov 08 17:38:48.030179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 3/10] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:38:47 2021] GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:48.500097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-770997829", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "networks": [{"uuid": "7538bf23-b616-4166-98b8-7a0c2b2bdf89"}]}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:48.663500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] validate_networks() for [('7538bf23-b616-4166-98b8-7a0c2b2bdf89', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:38:48.954495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Flavor limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:38:48.955083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Image limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:38:48.955480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Flavor pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:38:48.956297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Image pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:38:48.956924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:38:48.992450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:49.010944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:49.012201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:49.012790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:49.088345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Getting quotas for project 2aeacdcc2522496daf04e277f4de53c6. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:38:49.105114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Getting quotas for user 14608710751146fbb4a56bb75b2bf8ce and project 2aeacdcc2522496daf04e277f4de53c6. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:38:49.125821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Going to run 1 instances... {{(pid=127762) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:38:49.132437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:38:49.438271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-117eb95f-09f3-4576-9d20-ab909e196671 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.526874 Nov 08 17:38:49.439266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 8/11] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:38:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:38:49.449720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-48270ff0-8d79-4cb0-8d3f-12b31caa516d tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec7c75e0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:49.568817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-48270ff0-8d79-4cb0-8d3f-12b31caa516d tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 200 len: 346 microversion: 2.1 time: 0.128001 Nov 08 17:38:49.569746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 9/12] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:38:49 2021] GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:49.575644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-19b8a6a5-1231-413d-8756-1d2b6672a45b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:49.576523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-19b8a6a5-1231-413d-8756-1d2b6672a45b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:49.919105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-19b8a6a5-1231-413d-8756-1d2b6672a45b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:49.954389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-19b8a6a5-1231-413d-8756-1d2b6672a45b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1215 microversion: 2.1 time: 0.383204 Nov 08 17:38:49.985839 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 10/13] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:49 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1215 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:49.987435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:38:49.987435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:38:49.987435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:38:49.987435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:38:49.987435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:38:49.988278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3658b54f-9a92-4968-9a0d-6d3125af4daa tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Action: 'create', calling method: .version_select at 0x7f06ec805160>, body: {"snapshot": {"volume_id": "1ff29095-81da-4f00-b11a-65342cceeed4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1376972747"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:50.000122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:50.001873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:50.002983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:50.003637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:50.047659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Getting quotas for project ef1c05515852427e84b12522c50545fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:38:50.093704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Getting quotas for user 6ca86df4b2b6476fae354e9e96fbdf53 and project ef1c05515852427e84b12522c50545fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:38:50.128996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:38:50.138877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:38:50.466796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-edf472d3-3faa-4045-a5cd-dc12c6113620 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.329491 Nov 08 17:38:50.467483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 4/14] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:38:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 08 17:38:50.484847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bf7bd0cd-d66a-4b5a-ac9d-b029fecbdb26 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:50.499134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bf7bd0cd-d66a-4b5a-ac9d-b029fecbdb26 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:50.694737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bf7bd0cd-d66a-4b5a-ac9d-b029fecbdb26 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:50.722337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bf7bd0cd-d66a-4b5a-ac9d-b029fecbdb26 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1217 microversion: 2.1 time: 0.242383 Nov 08 17:38:50.723332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 5/15] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:50 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1217 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:50.759710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3658b54f-9a92-4968-9a0d-6d3125af4daa tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.795616 Nov 08 17:38:50.762584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 11/16] 10.222.0.18 () {60 vars in 1161 bytes} [Mon Nov 8 17:38:49 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:50.772874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f44f6952-7e30-4ea2-8c4e-72b221ee5cf9 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec805ee0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:50.897343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f44f6952-7e30-4ea2-8c4e-72b221ee5cf9 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 287 microversion: 2.1 time: 0.126362 Nov 08 17:38:50.897343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 6/17] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:50 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:50.905284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d1f7abb7-fd09-4bc1-a960-54c351d0f3c3 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec8053a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:50.961475 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d1f7abb7-fd09-4bc1-a960-54c351d0f3c3 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.060081 Nov 08 17:38:50.967118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 12/18] 10.222.0.18 () {58 vars in 1139 bytes} [Mon Nov 8 17:38:50 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:50.990507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-903f17ad-b1c3-4b77-a2eb-fb1b13ff526c tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec796310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:51.004195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3faf322a-4f41-4cb9-bdc4-36dc4009098f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:51.006213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3faf322a-4f41-4cb9-bdc4-36dc4009098f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:51.066231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-903f17ad-b1c3-4b77-a2eb-fb1b13ff526c tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 287 microversion: 2.1 time: 0.092481 Nov 08 17:38:51.073687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 7/19] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:50 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:51.125027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3faf322a-4f41-4cb9-bdc4-36dc4009098f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:51.140618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3faf322a-4f41-4cb9-bdc4-36dc4009098f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1215 microversion: 2.1 time: 0.140040 Nov 08 17:38:51.141746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 13/20] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:50 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:51.743564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8cd773ea-878c-4fe1-a0a0-95026b169a41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:51.744357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8cd773ea-878c-4fe1-a0a0-95026b169a41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:51.888563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8cd773ea-878c-4fe1-a0a0-95026b169a41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:51.922633 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8cd773ea-878c-4fe1-a0a0-95026b169a41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1217 microversion: 2.1 time: 0.181707 Nov 08 17:38:51.935327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 8/21] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:51 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:52.080851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-528dfba7-bc1a-431f-8c26-62b85c66530c tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec7999d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:52.149284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-528dfba7-bc1a-431f-8c26-62b85c66530c tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 287 microversion: 2.1 time: 0.072347 Nov 08 17:38:52.150435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 14/22] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:52 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:52.160473 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e1312397-0a56-4c7b-bf17-94f78ddf8f7d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:52.160473 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e1312397-0a56-4c7b-bf17-94f78ddf8f7d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:52.356125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e1312397-0a56-4c7b-bf17-94f78ddf8f7d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:52.376562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e1312397-0a56-4c7b-bf17-94f78ddf8f7d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1215 microversion: 2.1 time: 0.222277 Nov 08 17:38:52.377896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 9/23] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:52 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:52.943204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3e442934-150f-4352-9dfd-ff7aead43a92 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:52.944231 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3e442934-150f-4352-9dfd-ff7aead43a92 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:53.021164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3e442934-150f-4352-9dfd-ff7aead43a92 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:53.032277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3e442934-150f-4352-9dfd-ff7aead43a92 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1217 microversion: 2.1 time: 0.093303 Nov 08 17:38:53.040949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 15/24] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:52 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:38:53.163038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-07a8fca1-cb79-4e11-b985-cc6b6e7b4de2 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec7861f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:53.218113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-07a8fca1-cb79-4e11-b985-cc6b6e7b4de2 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 287 microversion: 2.1 time: 0.060280 Nov 08 17:38:53.219206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 10/25] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:53 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:53.392932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-73f319af-5fbf-4071-8e2d-ee91dc4aa563 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:53.394823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-73f319af-5fbf-4071-8e2d-ee91dc4aa563 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:53.401945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73f319af-5fbf-4071-8e2d-ee91dc4aa563 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:53.402402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73f319af-5fbf-4071-8e2d-ee91dc4aa563 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:53.403394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73f319af-5fbf-4071-8e2d-ee91dc4aa563 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:53.403682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73f319af-5fbf-4071-8e2d-ee91dc4aa563 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:53.564176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-73f319af-5fbf-4071-8e2d-ee91dc4aa563 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:53.589647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-73f319af-5fbf-4071-8e2d-ee91dc4aa563 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1219 microversion: 2.1 time: 0.200294 Nov 08 17:38:53.594848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 16/26] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:53 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1219 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:54.054286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c0043c86-c946-454f-9c9a-d0403cf74f8b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:54.055508 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c0043c86-c946-454f-9c9a-d0403cf74f8b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:54.068727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0043c86-c946-454f-9c9a-d0403cf74f8b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:54.069441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0043c86-c946-454f-9c9a-d0403cf74f8b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:54.070342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0043c86-c946-454f-9c9a-d0403cf74f8b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:54.072574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0043c86-c946-454f-9c9a-d0403cf74f8b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:54.230855 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fe38e8b4-179b-431b-b39f-60abf231ad28 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec70a940>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:54.278241 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fe38e8b4-179b-431b-b39f-60abf231ad28 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 287 microversion: 2.1 time: 0.052161 Nov 08 17:38:54.283509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 17/27] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:54 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:54.326186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c0043c86-c946-454f-9c9a-d0403cf74f8b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:54.355981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c0043c86-c946-454f-9c9a-d0403cf74f8b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1221 microversion: 2.1 time: 0.296749 Nov 08 17:38:54.356657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 11/28] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:54 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1221 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:54.611954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-11c50d75-774a-460e-b4b5-884e3d8133f8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:54.612716 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-11c50d75-774a-460e-b4b5-884e3d8133f8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:54.624230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-11c50d75-774a-460e-b4b5-884e3d8133f8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:54.624683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-11c50d75-774a-460e-b4b5-884e3d8133f8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:54.625479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-11c50d75-774a-460e-b4b5-884e3d8133f8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:54.625914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-11c50d75-774a-460e-b4b5-884e3d8133f8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:54.801392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-11c50d75-774a-460e-b4b5-884e3d8133f8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:54.810451 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-11c50d75-774a-460e-b4b5-884e3d8133f8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1219 microversion: 2.1 time: 0.202268 Nov 08 17:38:54.820517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 12/29] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:54 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1219 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:38:54.943540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5069dd28-a25f-421a-8a52-f8d0e01513c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'create', calling method: .version_select at 0x7f06ec7135e0>, body: {"keypair": {"name": "tempest-keypair-336226364"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:54.996329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-5069dd28-a25f-421a-8a52-f8d0e01513c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:38:55.014246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-5069dd28-a25f-421a-8a52-f8d0e01513c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for user d88ffa0544a14579bf1e045e795d551a and project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:38:55.289886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e3105396-a4d3-4be5-85a6-687691eb77a3 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec731940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:55.333032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-5069dd28-a25f-421a-8a52-f8d0e01513c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:38:55.336779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e3105396-a4d3-4be5-85a6-687691eb77a3 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 288 microversion: 2.1 time: 0.050486 Nov 08 17:38:55.343840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 13/30] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:55 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:38:55.346245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-5069dd28-a25f-421a-8a52-f8d0e01513c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for user d88ffa0544a14579bf1e045e795d551a and project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:38:55.349251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-029b0435-f356-453b-8927-289604d2ca78 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec7231f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:55.376114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5069dd28-a25f-421a-8a52-f8d0e01513c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.962547 Nov 08 17:38:55.376658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 18/31] 10.222.0.18 () {62 vars in 1198 bytes} [Mon Nov 8 17:38:54 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 964 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 08 17:38:55.390162 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1310c3a7-7e1b-4a92-a8e6-67eda1e338d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:55.391055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1310c3a7-7e1b-4a92-a8e6-67eda1e338d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:55.398400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1310c3a7-7e1b-4a92-a8e6-67eda1e338d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:55.398930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1310c3a7-7e1b-4a92-a8e6-67eda1e338d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:55.399717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1310c3a7-7e1b-4a92-a8e6-67eda1e338d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:55.400153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1310c3a7-7e1b-4a92-a8e6-67eda1e338d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:55.484905 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1310c3a7-7e1b-4a92-a8e6-67eda1e338d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:55.495787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1310c3a7-7e1b-4a92-a8e6-67eda1e338d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1213 microversion: 2.1 time: 0.111131 Nov 08 17:38:55.496285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 19/32] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:55 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:55.565495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-029b0435-f356-453b-8927-289604d2ca78 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 202 len: 0 microversion: 2.1 time: 0.220535 Nov 08 17:38:55.566201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 14/33] 10.222.0.18 () {58 vars in 1253 bytes} [Mon Nov 8 17:38:55 2021] DELETE /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:38:55.575167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b6127271-9bd7-437d-98b7-955efaa10d0f tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec72b160>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:55.640092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b6127271-9bd7-437d-98b7-955efaa10d0f tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 287 microversion: 2.1 time: 0.069021 Nov 08 17:38:55.640663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 20/34] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:55 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:38:56.030577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-afc7f58c-2d51-4445-ab83-20f4d25aa74a tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:56.030577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-afc7f58c-2d51-4445-ab83-20f4d25aa74a tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:56.030577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-afc7f58c-2d51-4445-ab83-20f4d25aa74a tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:56.030577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-afc7f58c-2d51-4445-ab83-20f4d25aa74a tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:56.033738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-afc7f58c-2d51-4445-ab83-20f4d25aa74a tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:56.033738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-afc7f58c-2d51-4445-ab83-20f4d25aa74a tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:56.033738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-afc7f58c-2d51-4445-ab83-20f4d25aa74a tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:56.038938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-afc7f58c-2d51-4445-ab83-20f4d25aa74a tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1211 microversion: 2.1 time: 0.178023 Nov 08 17:38:56.038938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 15/35] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:55 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1211 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:56.514302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5086d8d5-1089-4777-ab8f-49185aec246c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:56.514950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5086d8d5-1089-4777-ab8f-49185aec246c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:56.530009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5086d8d5-1089-4777-ab8f-49185aec246c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:56.530471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5086d8d5-1089-4777-ab8f-49185aec246c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:56.531283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5086d8d5-1089-4777-ab8f-49185aec246c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:56.531719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5086d8d5-1089-4777-ab8f-49185aec246c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:56.653170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6808d04d-d4fb-4cba-8c00-cb353b801d82 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec7319d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:56.698196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5086d8d5-1089-4777-ab8f-49185aec246c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:56.705979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6808d04d-d4fb-4cba-8c00-cb353b801d82 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 287 microversion: 2.1 time: 0.057635 Nov 08 17:38:56.707001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 16/36] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:56 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:38:56.741069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5086d8d5-1089-4777-ab8f-49185aec246c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1213 microversion: 2.1 time: 0.228240 Nov 08 17:38:56.743697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 21/37] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:56 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1213 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:57.019268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ec4cd3bb-e6cd-4410-b3a7-09ec3ea36b8f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:57.026199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ec4cd3bb-e6cd-4410-b3a7-09ec3ea36b8f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:57.034077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec4cd3bb-e6cd-4410-b3a7-09ec3ea36b8f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:57.039391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec4cd3bb-e6cd-4410-b3a7-09ec3ea36b8f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:57.039391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec4cd3bb-e6cd-4410-b3a7-09ec3ea36b8f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:57.039391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec4cd3bb-e6cd-4410-b3a7-09ec3ea36b8f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:57.176116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ec4cd3bb-e6cd-4410-b3a7-09ec3ea36b8f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:57.198146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ec4cd3bb-e6cd-4410-b3a7-09ec3ea36b8f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1211 microversion: 2.1 time: 0.182494 Nov 08 17:38:57.209165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 17/38] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:57 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1211 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:57.718555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3f36b6df-5de7-468e-bd52-35879ea3e318 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec786e50>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:57.788519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3f36b6df-5de7-468e-bd52-35879ea3e318 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 200 len: 287 microversion: 2.1 time: 0.073567 Nov 08 17:38:57.789089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 18/39] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:57 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:38:57.799173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ca561569-8b93-440b-9639-35f86dad1c27 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:57.799968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ca561569-8b93-440b-9639-35f86dad1c27 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:57.819055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca561569-8b93-440b-9639-35f86dad1c27 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:57.823861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca561569-8b93-440b-9639-35f86dad1c27 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:57.826631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca561569-8b93-440b-9639-35f86dad1c27 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:57.827020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca561569-8b93-440b-9639-35f86dad1c27 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:57.975702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ca561569-8b93-440b-9639-35f86dad1c27 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:58.018380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cb2411ad-d571-49af-82e7-d63b98e454e8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'create', calling method: .version_select at 0x7f06ec7991f0>, body: {"keypair": {"name": "tempest-keypair-47629218"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:58.032782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ca561569-8b93-440b-9639-35f86dad1c27 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1213 microversion: 2.1 time: 0.237863 Nov 08 17:38:58.033672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 19/40] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:57 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1213 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:58.064903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-cb2411ad-d571-49af-82e7-d63b98e454e8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for project 8cf7369a158d465290a1686f76514638. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:38:58.071122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-cb2411ad-d571-49af-82e7-d63b98e454e8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for user 38b562a5b8db48508f2b712487d4ca4a and project 8cf7369a158d465290a1686f76514638. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:38:58.216749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3199bee5-170c-4764-a418-bb6758f3b0be tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:58.217857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3199bee5-170c-4764-a418-bb6758f3b0be tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:58.228314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3199bee5-170c-4764-a418-bb6758f3b0be tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:58.229099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3199bee5-170c-4764-a418-bb6758f3b0be tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:58.230102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3199bee5-170c-4764-a418-bb6758f3b0be tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:58.231324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3199bee5-170c-4764-a418-bb6758f3b0be tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:58.397458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3199bee5-170c-4764-a418-bb6758f3b0be tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:58.405699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3199bee5-170c-4764-a418-bb6758f3b0be tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1267 microversion: 2.1 time: 0.192714 Nov 08 17:38:58.410092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:58 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:58.612728 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-cb2411ad-d571-49af-82e7-d63b98e454e8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for project 8cf7369a158d465290a1686f76514638. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:38:58.635571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-cb2411ad-d571-49af-82e7-d63b98e454e8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for user 38b562a5b8db48508f2b712487d4ca4a and project 8cf7369a158d465290a1686f76514638. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:38:58.666604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cb2411ad-d571-49af-82e7-d63b98e454e8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 1.150136 Nov 08 17:38:58.667226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1157 bytes} [Mon Nov 8 17:38:57 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:38:58.800043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a7124033-e3a5-4dfa-8d93-7e89185d3c0a tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec7313a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:58.894027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-a7124033-e3a5-4dfa-8d93-7e89185d3c0a tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] HTTP exception thrown: Snapshot b95c9a8a-7e68-4c34-a111-e6f57080957d could not be found. Nov 08 17:38:58.894873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a7124033-e3a5-4dfa-8d93-7e89185d3c0a tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Returning 404 to user: Snapshot b95c9a8a-7e68-4c34-a111-e6f57080957d could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:38:58.896535 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a7124033-e3a5-4dfa-8d93-7e89185d3c0a tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d" status: 404 len: 111 microversion: 2.1 time: 0.100132 Nov 08 17:38:58.897885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:38:58 2021] GET /compute/v2.1/os-snapshots/b95c9a8a-7e68-4c34-a111-e6f57080957d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:38:58.910172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-629a7d15-a4b8-4868-913d-05d75e1dc1cf tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec731f70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:59.053714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0696c527-c32c-4868-827f-c581330638e1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:59.054327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0696c527-c32c-4868-827f-c581330638e1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:59.063108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0696c527-c32c-4868-827f-c581330638e1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:59.066922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0696c527-c32c-4868-827f-c581330638e1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:59.068758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0696c527-c32c-4868-827f-c581330638e1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:59.069204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0696c527-c32c-4868-827f-c581330638e1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:59.227642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0696c527-c32c-4868-827f-c581330638e1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:59.255243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0696c527-c32c-4868-827f-c581330638e1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1269 microversion: 2.1 time: 0.205703 Nov 08 17:38:59.260681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 22/44] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:59 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1269 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:38:59.429702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d94c5aa2-753b-4224-ac32-11d3974c8da8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:38:59.430555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d94c5aa2-753b-4224-ac32-11d3974c8da8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:38:59.442520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d94c5aa2-753b-4224-ac32-11d3974c8da8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:59.445060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d94c5aa2-753b-4224-ac32-11d3974c8da8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:59.449407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d94c5aa2-753b-4224-ac32-11d3974c8da8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:38:59.450774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d94c5aa2-753b-4224-ac32-11d3974c8da8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:38:59.665860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d94c5aa2-753b-4224-ac32-11d3974c8da8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:38:59.676066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d94c5aa2-753b-4224-ac32-11d3974c8da8 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1273 microversion: 2.1 time: 0.249632 Nov 08 17:38:59.678287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 23/45] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:38:59 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:38:59.754373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-597867046", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34ca4a7c-c4ab-4bf8-99e5-603019d7c10d"}], "security_groups": [{"name": "tempest-securitygroup--609882407"}], "key_name": "tempest-keypair-336226364", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:38:59.918988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-629a7d15-a4b8-4868-913d-05d75e1dc1cf tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 202 len: 0 microversion: 2.1 time: 1.016622 Nov 08 17:38:59.920716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 23/46] 10.222.0.18 () {58 vars in 1247 bytes} [Mon Nov 8 17:38:58 2021] DELETE /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:38:59.929723 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f75de29b-238a-4809-ab05-84357cea620b tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec6c6670>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:00.060696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f75de29b-238a-4809-ab05-84357cea620b tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 200 len: 345 microversion: 2.1 time: 0.134789 Nov 08 17:39:00.061709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 24/47] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:38:59 2021] GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:00.215271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] validate_networks() for [('34ca4a7c-c4ab-4bf8-99e5-603019d7c10d', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:39:00.275684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5c9c2b17-27a9-4a70-bde1-da698ed237ac tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:00.276292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5c9c2b17-27a9-4a70-bde1-da698ed237ac tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:00.293656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c9c2b17-27a9-4a70-bde1-da698ed237ac tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:00.294123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c9c2b17-27a9-4a70-bde1-da698ed237ac tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:00.295017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c9c2b17-27a9-4a70-bde1-da698ed237ac tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:00.295455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c9c2b17-27a9-4a70-bde1-da698ed237ac tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:00.409194 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5c9c2b17-27a9-4a70-bde1-da698ed237ac tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:00.419934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5c9c2b17-27a9-4a70-bde1-da698ed237ac tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1275 microversion: 2.1 time: 0.147900 Nov 08 17:39:00.429971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:00 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:00.693865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a36a92eb-c458-40f1-b329-ea628aa43230 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:00.695053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a36a92eb-c458-40f1-b329-ea628aa43230 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:00.710414 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a36a92eb-c458-40f1-b329-ea628aa43230 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:00.719286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a36a92eb-c458-40f1-b329-ea628aa43230 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:00.722838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a36a92eb-c458-40f1-b329-ea628aa43230 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:00.730443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a36a92eb-c458-40f1-b329-ea628aa43230 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:00.984587 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a36a92eb-c458-40f1-b329-ea628aa43230 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:01.002951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a36a92eb-c458-40f1-b329-ea628aa43230 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1273 microversion: 2.1 time: 0.312983 Nov 08 17:39:01.015981 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 26/49] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:00 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1273 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:01.081049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9251a34b-9be6-4397-b77e-42aa39baab66 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec805160>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:01.199694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9251a34b-9be6-4397-b77e-42aa39baab66 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 200 len: 345 microversion: 2.1 time: 0.127802 Nov 08 17:39:01.200291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 27/50] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:39:01 2021] GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:01.442950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1009143a-b855-402d-8b07-140055b58678 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:01.442950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1009143a-b855-402d-8b07-140055b58678 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:01.449318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1009143a-b855-402d-8b07-140055b58678 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:01.450230 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1009143a-b855-402d-8b07-140055b58678 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:01.456239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1009143a-b855-402d-8b07-140055b58678 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:01.457287 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1009143a-b855-402d-8b07-140055b58678 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:01.858574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:39:01.859779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:39:01.860430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:39:01.860841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:39:01.861245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:39:01.870934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:01.871943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:01.873551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:01.874198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:01.933695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:39:01.938448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for user d88ffa0544a14579bf1e045e795d551a and project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:39:01.956176 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:39:01.959473 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:39:01.967101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1009143a-b855-402d-8b07-140055b58678 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:01.976596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1009143a-b855-402d-8b07-140055b58678 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.543293 Nov 08 17:39:01.977190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 28/51] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:01 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:02.021221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b188eca5-216e-46e8-8113-d9506ff5af6b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:02.022004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b188eca5-216e-46e8-8113-d9506ff5af6b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:02.028042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b188eca5-216e-46e8-8113-d9506ff5af6b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:02.028499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b188eca5-216e-46e8-8113-d9506ff5af6b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:02.029417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b188eca5-216e-46e8-8113-d9506ff5af6b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:02.030155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b188eca5-216e-46e8-8113-d9506ff5af6b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:02.103164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9aafacb7-877b-4edd-ba68-0c71c744ba45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.353594 Nov 08 17:39:02.104156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 24/52] 10.222.0.18 () {62 vars in 1187 bytes} [Mon Nov 8 17:38:59 2021] POST /compute/v2.1/servers => generated 401 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 08 17:39:02.114445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4dbd5e81-2b24-4a0d-8050-a52e029ba876 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:02.115109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4dbd5e81-2b24-4a0d-8050-a52e029ba876 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:02.188115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4dbd5e81-2b24-4a0d-8050-a52e029ba876 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:02.204927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4dbd5e81-2b24-4a0d-8050-a52e029ba876 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:02.206609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4dbd5e81-2b24-4a0d-8050-a52e029ba876 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:02.211267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4dbd5e81-2b24-4a0d-8050-a52e029ba876 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1280 microversion: 2.20 time: 0.100624 Nov 08 17:39:02.212027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 25/53] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:02.217576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-974318b2-4368-4daa-b623-8c05b2ed3766 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec6f99d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:02.293981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-974318b2-4368-4daa-b623-8c05b2ed3766 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 200 len: 345 microversion: 2.1 time: 0.080025 Nov 08 17:39:02.299814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 26/54] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:39:02 2021] GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:02.329285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b188eca5-216e-46e8-8113-d9506ff5af6b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:02.337666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b188eca5-216e-46e8-8113-d9506ff5af6b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.321060 Nov 08 17:39:02.341399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 29/55] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:02 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:02.667671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-401071547", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1439e79-2a1d-4b5f-945c-aec344d750cf"}], "security_groups": [{"name": "tempest-securitygroup--1750194956"}], "key_name": "tempest-keypair-47629218", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:02.781472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] validate_networks() for [('e1439e79-2a1d-4b5f-945c-aec344d750cf', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:39:02.994229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8df05b40-ba73-4320-9cc2-ccfeab8ba702 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:02.997155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8df05b40-ba73-4320-9cc2-ccfeab8ba702 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:03.008642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df05b40-ba73-4320-9cc2-ccfeab8ba702 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:03.010155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df05b40-ba73-4320-9cc2-ccfeab8ba702 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:03.011280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df05b40-ba73-4320-9cc2-ccfeab8ba702 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:03.013492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df05b40-ba73-4320-9cc2-ccfeab8ba702 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:03.342396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8df05b40-ba73-4320-9cc2-ccfeab8ba702 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:03.353105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8df05b40-ba73-4320-9cc2-ccfeab8ba702 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.363561 Nov 08 17:39:03.355607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 30/56] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:02 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:03.369399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2c86b604-d3c1-4b0a-9909-d47b5281a60b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:03.372121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2c86b604-d3c1-4b0a-9909-d47b5281a60b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:03.396080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:39:03.396689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:39:03.396689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:39:03.396954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:39:03.397360 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:39:03.431141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:03.433434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:03.447592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:03.447592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:03.488199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2c86b604-d3c1-4b0a-9909-d47b5281a60b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:03.498331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2c86b604-d3c1-4b0a-9909-d47b5281a60b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:03.499538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for project 8cf7369a158d465290a1686f76514638. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:39:03.506880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for user 38b562a5b8db48508f2b712487d4ca4a and project 8cf7369a158d465290a1686f76514638. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:39:03.507978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2c86b604-d3c1-4b0a-9909-d47b5281a60b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:03.511014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2c86b604-d3c1-4b0a-9909-d47b5281a60b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1280 microversion: 2.20 time: 0.152471 Nov 08 17:39:03.513164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 31/57] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:03.517524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d127ad44-01b1-437f-80c9-d04e9861648b tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec72b820>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:03.520260 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:39:03.523410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:39:03.625144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-d127ad44-01b1-437f-80c9-d04e9861648b tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] HTTP exception thrown: Volume 1ff29095-81da-4f00-b11a-65342cceeed4 could not be found. Nov 08 17:39:03.625894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d127ad44-01b1-437f-80c9-d04e9861648b tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Returning 404 to user: Volume 1ff29095-81da-4f00-b11a-65342cceeed4 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:39:03.627376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d127ad44-01b1-437f-80c9-d04e9861648b tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 404 len: 109 microversion: 2.1 time: 0.112966 Nov 08 17:39:03.628392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 32/58] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:39:03 2021] GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:39:03.634668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7217ff0a-b995-4b1e-a281-102a84faf68d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:03.637246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7217ff0a-b995-4b1e-a281-102a84faf68d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:03.658945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7217ff0a-b995-4b1e-a281-102a84faf68d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:03.670263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7217ff0a-b995-4b1e-a281-102a84faf68d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:03.690367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7217ff0a-b995-4b1e-a281-102a84faf68d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:03.690367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7217ff0a-b995-4b1e-a281-102a84faf68d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:03.814308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8dbc66cd-e0a0-47e2-b375-492f716e703f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.150737 Nov 08 17:39:03.818049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 27/59] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:39:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:39:03.833904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4d940de9-b2cc-4377-b487-957d3fcd930f tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec711d30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:03.886384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7217ff0a-b995-4b1e-a281-102a84faf68d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:03.896109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7217ff0a-b995-4b1e-a281-102a84faf68d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.265747 Nov 08 17:39:03.897473 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 33/60] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:03 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:03.902313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-10a2f59c-b5c7-4f5c-8e34-ac1a28d0e1f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:03.903147 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-10a2f59c-b5c7-4f5c-8e34-ac1a28d0e1f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:03.988663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-10a2f59c-b5c7-4f5c-8e34-ac1a28d0e1f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:03.993544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-10a2f59c-b5c7-4f5c-8e34-ac1a28d0e1f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1235 microversion: 2.1 time: 0.094525 Nov 08 17:39:03.994083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 34/61] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:03 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1235 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:04.084637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-4d940de9-b2cc-4377-b487-957d3fcd930f tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] HTTP exception thrown: Volume 1ff29095-81da-4f00-b11a-65342cceeed4 could not be found. Nov 08 17:39:04.085314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4d940de9-b2cc-4377-b487-957d3fcd930f tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Returning 404 to user: Volume 1ff29095-81da-4f00-b11a-65342cceeed4 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:39:04.086211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4d940de9-b2cc-4377-b487-957d3fcd930f tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 404 len: 109 microversion: 2.1 time: 0.266995 Nov 08 17:39:04.086898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 28/62] 10.222.0.18 () {58 vars in 1247 bytes} [Mon Nov 8 17:39:03 2021] DELETE /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 109 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:39:04.094945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9cce49f5-6acf-4803-8c28-2aefa827a3b6 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Calling method '.version_select at 0x7f06ec6ac820>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:04.372560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-304b82c3-97a2-4409-a3fa-cfaace9fa90b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:04.373235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-304b82c3-97a2-4409-a3fa-cfaace9fa90b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:04.379519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-304b82c3-97a2-4409-a3fa-cfaace9fa90b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:04.379896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-304b82c3-97a2-4409-a3fa-cfaace9fa90b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:04.380671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-304b82c3-97a2-4409-a3fa-cfaace9fa90b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:04.381268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-304b82c3-97a2-4409-a3fa-cfaace9fa90b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:04.496438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-9cce49f5-6acf-4803-8c28-2aefa827a3b6 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] HTTP exception thrown: Volume 1ff29095-81da-4f00-b11a-65342cceeed4 could not be found. Nov 08 17:39:04.497866 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9cce49f5-6acf-4803-8c28-2aefa827a3b6 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] Returning 404 to user: Volume 1ff29095-81da-4f00-b11a-65342cceeed4 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:39:04.498973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9cce49f5-6acf-4803-8c28-2aefa827a3b6 tempest-VolumesSnapshotsTestJSON-556393059 tempest-VolumesSnapshotsTestJSON-556393059-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4" status: 404 len: 109 microversion: 2.1 time: 0.407837 Nov 08 17:39:04.499535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 35/63] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:39:04 2021] GET /compute/v2.1/os-volumes/1ff29095-81da-4f00-b11a-65342cceeed4 => generated 109 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:39:04.530528 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:04.531437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:04.548870 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:04.549687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:04.550942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:04.552540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:04.657233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:04.670998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:04.676142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:04.677879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ddb7fd67-1adf-4144-95df-1e0152ec7586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1284 microversion: 2.20 time: 0.152101 Nov 08 17:39:04.684022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 36/64] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:04.685867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-304b82c3-97a2-4409-a3fa-cfaace9fa90b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:04.710957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-304b82c3-97a2-4409-a3fa-cfaace9fa90b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.341805 Nov 08 17:39:04.711607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 29/65] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:04 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:05.045506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ff2caf4e-90c8-4db5-b047-adf9eb233ff6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:05.045506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ff2caf4e-90c8-4db5-b047-adf9eb233ff6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:05.045506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ff2caf4e-90c8-4db5-b047-adf9eb233ff6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:05.045506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ff2caf4e-90c8-4db5-b047-adf9eb233ff6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:05.045930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ff2caf4e-90c8-4db5-b047-adf9eb233ff6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:05.045930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ff2caf4e-90c8-4db5-b047-adf9eb233ff6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:05.046052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3191aff5-b417-4321-a008-3759fae3377e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:05.046052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3191aff5-b417-4321-a008-3759fae3377e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:05.086414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3191aff5-b417-4321-a008-3759fae3377e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:05.090127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ff2caf4e-90c8-4db5-b047-adf9eb233ff6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:05.098352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ff2caf4e-90c8-4db5-b047-adf9eb233ff6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.188292 Nov 08 17:39:05.100172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 37/66] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:04 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:05.105120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3191aff5-b417-4321-a008-3759fae3377e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1235 microversion: 2.1 time: 0.097389 Nov 08 17:39:05.105757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 30/67] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:05 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:05.700987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:05.702303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:05.709140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:05.709573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:05.710615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:05.711269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:05.727477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-615ef835-4ec0-4fea-b727-e38fffc6e52c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:05.728813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-615ef835-4ec0-4fea-b727-e38fffc6e52c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:05.741512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-615ef835-4ec0-4fea-b727-e38fffc6e52c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:05.741512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-615ef835-4ec0-4fea-b727-e38fffc6e52c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:05.741751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-615ef835-4ec0-4fea-b727-e38fffc6e52c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:05.742343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-615ef835-4ec0-4fea-b727-e38fffc6e52c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:05.861468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:05.874181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:05.875789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:05.876922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7d592b61-1745-4175-a61d-1464900c649c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1284 microversion: 2.20 time: 0.180469 Nov 08 17:39:05.877837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 38/68] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:39:06.125143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e90e9cda-8734-4a61-bab7-c8537f3c1fcb tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:06.126215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e90e9cda-8734-4a61-bab7-c8537f3c1fcb tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:06.135434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e90e9cda-8734-4a61-bab7-c8537f3c1fcb tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:06.136779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e90e9cda-8734-4a61-bab7-c8537f3c1fcb tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:06.136779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e90e9cda-8734-4a61-bab7-c8537f3c1fcb tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:06.137304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e90e9cda-8734-4a61-bab7-c8537f3c1fcb tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:06.200202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-615ef835-4ec0-4fea-b727-e38fffc6e52c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:06.209089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-615ef835-4ec0-4fea-b727-e38fffc6e52c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.485182 Nov 08 17:39:06.209674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 31/69] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:05 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:06.215614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f4c14ee4-8012-4a56-ace8-870c651deb87 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:06.216565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f4c14ee4-8012-4a56-ace8-870c651deb87 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:06.223943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4c14ee4-8012-4a56-ace8-870c651deb87 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:06.224646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4c14ee4-8012-4a56-ace8-870c651deb87 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:06.225446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4c14ee4-8012-4a56-ace8-870c651deb87 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:06.225887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4c14ee4-8012-4a56-ace8-870c651deb87 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:06.293820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f4c14ee4-8012-4a56-ace8-870c651deb87 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:06.301634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f4c14ee4-8012-4a56-ace8-870c651deb87 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1239 microversion: 2.1 time: 0.090477 Nov 08 17:39:06.302217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 32/70] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:06 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:06.353477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e90e9cda-8734-4a61-bab7-c8537f3c1fcb tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:06.360804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e90e9cda-8734-4a61-bab7-c8537f3c1fcb tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.241232 Nov 08 17:39:06.361375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 39/71] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:06 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:06.899826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:06.900461 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:06.906876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:06.907437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:06.908382 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:06.914667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:06.999575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:07.015331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:07.017261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:07.018764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-32bbb4a7-191c-40da-812e-7bf42f0cd745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1284 microversion: 2.20 time: 0.127712 Nov 08 17:39:07.019796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 33/72] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:07.277148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dbcf099f-127e-4cef-9861-62488e20dcaa tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:07.277825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dbcf099f-127e-4cef-9861-62488e20dcaa tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:07.284273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbcf099f-127e-4cef-9861-62488e20dcaa tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:07.284811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbcf099f-127e-4cef-9861-62488e20dcaa tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:07.287185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbcf099f-127e-4cef-9861-62488e20dcaa tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:07.287639 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbcf099f-127e-4cef-9861-62488e20dcaa tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:07.323564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2f301fea-95e0-423d-8578-b10b5a3de031 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:07.324163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2f301fea-95e0-423d-8578-b10b5a3de031 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:07.330847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2f301fea-95e0-423d-8578-b10b5a3de031 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:07.331331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2f301fea-95e0-423d-8578-b10b5a3de031 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:07.335559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2f301fea-95e0-423d-8578-b10b5a3de031 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:07.336012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2f301fea-95e0-423d-8578-b10b5a3de031 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:07.527933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2f301fea-95e0-423d-8578-b10b5a3de031 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:07.538716 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2f301fea-95e0-423d-8578-b10b5a3de031 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1239 microversion: 2.1 time: 0.218530 Nov 08 17:39:07.539305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 34/73] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:07 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1239 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:07.549358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-79a540a0-cc1d-4eda-8135-ca43b2f10dc6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:07.552054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-79a540a0-cc1d-4eda-8135-ca43b2f10dc6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:07.556871 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79a540a0-cc1d-4eda-8135-ca43b2f10dc6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:07.557665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79a540a0-cc1d-4eda-8135-ca43b2f10dc6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:07.558452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79a540a0-cc1d-4eda-8135-ca43b2f10dc6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:07.558902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79a540a0-cc1d-4eda-8135-ca43b2f10dc6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:07.566114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dbcf099f-127e-4cef-9861-62488e20dcaa tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:07.583425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dbcf099f-127e-4cef-9861-62488e20dcaa tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.309978 Nov 08 17:39:07.593918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 40/74] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:07 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:07.792020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-79a540a0-cc1d-4eda-8135-ca43b2f10dc6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:07.808787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-79a540a0-cc1d-4eda-8135-ca43b2f10dc6 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.264452 Nov 08 17:39:07.810780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 35/75] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:07 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:08.037816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:08.038860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:08.049352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:08.049903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:08.050791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:08.051451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:08.128884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:08.144187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:08.146566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:08.148131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-41b8de2b-a05e-4ec4-b2a1-2dc1fbe75003 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1284 microversion: 2.20 time: 0.114460 Nov 08 17:39:08.148706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 41/76] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:08.555654 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bb327c7a-7904-49f0-9459-34a82271490c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:08.557116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bb327c7a-7904-49f0-9459-34a82271490c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:08.564046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb327c7a-7904-49f0-9459-34a82271490c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:08.565397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb327c7a-7904-49f0-9459-34a82271490c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:08.569996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb327c7a-7904-49f0-9459-34a82271490c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:08.570781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb327c7a-7904-49f0-9459-34a82271490c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:08.601064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-15fb8840-1d39-4352-99a6-99f733c83c06 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:08.601847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-15fb8840-1d39-4352-99a6-99f733c83c06 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:08.611895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-15fb8840-1d39-4352-99a6-99f733c83c06 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:08.613028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-15fb8840-1d39-4352-99a6-99f733c83c06 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:08.616913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-15fb8840-1d39-4352-99a6-99f733c83c06 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:08.617543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-15fb8840-1d39-4352-99a6-99f733c83c06 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:08.699479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bb327c7a-7904-49f0-9459-34a82271490c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:08.707102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bb327c7a-7904-49f0-9459-34a82271490c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1239 microversion: 2.1 time: 0.155442 Nov 08 17:39:08.708723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 36/77] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:08 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1239 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:08.873618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-15fb8840-1d39-4352-99a6-99f733c83c06 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:08.873618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-15fb8840-1d39-4352-99a6-99f733c83c06 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.215867 Nov 08 17:39:08.873618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 42/78] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:08 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:08.874398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-588b91b7-5db8-4f37-a81a-7ac3be7e52df tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:08.874398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-588b91b7-5db8-4f37-a81a-7ac3be7e52df tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:08.874398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-588b91b7-5db8-4f37-a81a-7ac3be7e52df tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:08.874398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-588b91b7-5db8-4f37-a81a-7ac3be7e52df tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:08.875141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-588b91b7-5db8-4f37-a81a-7ac3be7e52df tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:08.875141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-588b91b7-5db8-4f37-a81a-7ac3be7e52df tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:08.986441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-588b91b7-5db8-4f37-a81a-7ac3be7e52df tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:08.997458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-588b91b7-5db8-4f37-a81a-7ac3be7e52df tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.173620 Nov 08 17:39:09.008449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 37/79] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:08 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:09.166687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:09.167523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:09.177644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:09.178246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:09.179461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:09.179999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:09.258038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:09.271339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:09.273136 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:09.274299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-29a5d4ff-47ba-430d-baa0-8565adec8c21 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1284 microversion: 2.20 time: 0.111507 Nov 08 17:39:09.286847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 43/80] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:09.725813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-17d06d8c-e99c-4f81-8d26-e52071df78f5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:09.726607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-17d06d8c-e99c-4f81-8d26-e52071df78f5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:09.737710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17d06d8c-e99c-4f81-8d26-e52071df78f5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:09.738046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17d06d8c-e99c-4f81-8d26-e52071df78f5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:09.739899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17d06d8c-e99c-4f81-8d26-e52071df78f5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:09.740692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17d06d8c-e99c-4f81-8d26-e52071df78f5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:09.828948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-17d06d8c-e99c-4f81-8d26-e52071df78f5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:09.829547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-17d06d8c-e99c-4f81-8d26-e52071df78f5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1239 microversion: 2.1 time: 0.108117 Nov 08 17:39:09.830205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 38/81] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:09 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1239 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:09.876874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5887a7b3-9ee7-4b30-a61e-052d15937da5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:09.877470 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5887a7b3-9ee7-4b30-a61e-052d15937da5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:09.885140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5887a7b3-9ee7-4b30-a61e-052d15937da5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:09.885582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5887a7b3-9ee7-4b30-a61e-052d15937da5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:09.886350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5887a7b3-9ee7-4b30-a61e-052d15937da5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:09.886805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5887a7b3-9ee7-4b30-a61e-052d15937da5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:10.017194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5d10c7e0-f6ae-477d-9914-9c248156611f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:10.018088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5d10c7e0-f6ae-477d-9914-9c248156611f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:10.049639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d10c7e0-f6ae-477d-9914-9c248156611f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:10.052191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d10c7e0-f6ae-477d-9914-9c248156611f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:10.055688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d10c7e0-f6ae-477d-9914-9c248156611f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:10.057051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d10c7e0-f6ae-477d-9914-9c248156611f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:10.105209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5887a7b3-9ee7-4b30-a61e-052d15937da5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:10.122813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5887a7b3-9ee7-4b30-a61e-052d15937da5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.240470 Nov 08 17:39:10.122813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 44/82] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:09 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:10.272817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5d10c7e0-f6ae-477d-9914-9c248156611f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:10.292887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:10.293863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:10.298521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5d10c7e0-f6ae-477d-9914-9c248156611f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.283606 Nov 08 17:39:10.299144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 39/83] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:10 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:10.315012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:10.324930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:10.326251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:10.326964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:10.438032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:10.448960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:10.450502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:10.451646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d88e63d8-ab8b-451f-9a44-d1ba6875ff32 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1284 microversion: 2.20 time: 0.163839 Nov 08 17:39:10.453036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 45/84] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:10.852146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-40753297-21fa-4bd7-9ca6-12801e21126d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:10.860891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-40753297-21fa-4bd7-9ca6-12801e21126d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:10.886035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-40753297-21fa-4bd7-9ca6-12801e21126d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:10.888204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-40753297-21fa-4bd7-9ca6-12801e21126d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:10.888204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-40753297-21fa-4bd7-9ca6-12801e21126d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:10.888204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-40753297-21fa-4bd7-9ca6-12801e21126d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:10.958583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-40753297-21fa-4bd7-9ca6-12801e21126d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:10.967206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-40753297-21fa-4bd7-9ca6-12801e21126d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1239 microversion: 2.1 time: 0.119559 Nov 08 17:39:10.967779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 40/85] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:10 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1239 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:11.132784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-243985aa-ec18-4726-be22-d61e03cd4c2a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:11.137588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-243985aa-ec18-4726-be22-d61e03cd4c2a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:11.139324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-243985aa-ec18-4726-be22-d61e03cd4c2a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:11.139762 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-243985aa-ec18-4726-be22-d61e03cd4c2a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:11.140602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-243985aa-ec18-4726-be22-d61e03cd4c2a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:11.141023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-243985aa-ec18-4726-be22-d61e03cd4c2a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:11.316486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4b7db5db-ac26-46c3-96ee-7a5709a04c3d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:11.317938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4b7db5db-ac26-46c3-96ee-7a5709a04c3d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:11.327251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b7db5db-ac26-46c3-96ee-7a5709a04c3d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:11.328232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b7db5db-ac26-46c3-96ee-7a5709a04c3d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:11.329013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b7db5db-ac26-46c3-96ee-7a5709a04c3d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:11.329670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b7db5db-ac26-46c3-96ee-7a5709a04c3d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:11.354072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-243985aa-ec18-4726-be22-d61e03cd4c2a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:11.367030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-243985aa-ec18-4726-be22-d61e03cd4c2a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.238177 Nov 08 17:39:11.367982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 46/86] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:11 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:11.470238 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:11.470863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:11.478339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:11.478810 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:11.479591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:11.480199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:11.493375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4b7db5db-ac26-46c3-96ee-7a5709a04c3d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:11.501936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4b7db5db-ac26-46c3-96ee-7a5709a04c3d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.189481 Nov 08 17:39:11.503950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 41/87] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:11 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:11.572595 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:11.581147 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:11.583879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:11.584999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d1882918-4ae2-4a5a-88d8-65d12c9c7ce9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1284 microversion: 2.20 time: 0.118418 Nov 08 17:39:11.585560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 47/88] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:11.985523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c8523137-b591-4835-8a33-350d3983aeb4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:11.986975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c8523137-b591-4835-8a33-350d3983aeb4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:11.998454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c8523137-b591-4835-8a33-350d3983aeb4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:11.999142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c8523137-b591-4835-8a33-350d3983aeb4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:12.000085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c8523137-b591-4835-8a33-350d3983aeb4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:12.000935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c8523137-b591-4835-8a33-350d3983aeb4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:12.071421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c8523137-b591-4835-8a33-350d3983aeb4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:12.078934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c8523137-b591-4835-8a33-350d3983aeb4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1239 microversion: 2.1 time: 0.097497 Nov 08 17:39:12.081840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 42/89] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:11 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1239 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:12.388921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b1abef14-fe00-41fd-9d2d-9b7602e4c787 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:12.389546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b1abef14-fe00-41fd-9d2d-9b7602e4c787 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:12.395964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1abef14-fe00-41fd-9d2d-9b7602e4c787 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:12.396509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1abef14-fe00-41fd-9d2d-9b7602e4c787 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:12.397247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1abef14-fe00-41fd-9d2d-9b7602e4c787 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:12.397666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1abef14-fe00-41fd-9d2d-9b7602e4c787 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:12.524370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ae42de85-baee-4073-ac63-2422f375ac83 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:12.525307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ae42de85-baee-4073-ac63-2422f375ac83 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:12.531091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae42de85-baee-4073-ac63-2422f375ac83 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:12.531911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae42de85-baee-4073-ac63-2422f375ac83 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:12.532973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae42de85-baee-4073-ac63-2422f375ac83 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:12.533202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae42de85-baee-4073-ac63-2422f375ac83 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:12.541854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b1abef14-fe00-41fd-9d2d-9b7602e4c787 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:12.552442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b1abef14-fe00-41fd-9d2d-9b7602e4c787 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.165977 Nov 08 17:39:12.553024 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 48/90] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:12 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:12.664270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:12.664270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:12.677192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:12.678816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:12.680605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:12.681264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:12.758230 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:12.768657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ae42de85-baee-4073-ac63-2422f375ac83 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:12.769533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:12.772025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:12.773225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-27c561fa-a4e7-4bd9-8d16-a23309958a4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1284 microversion: 2.20 time: 0.173765 Nov 08 17:39:12.778509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 49/91] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:12.778677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ae42de85-baee-4073-ac63-2422f375ac83 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.257567 Nov 08 17:39:12.779435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 43/92] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:12 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:13.098958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d0f4fbf8-481d-4df3-a5b6-8213c9501cbc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:13.099672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d0f4fbf8-481d-4df3-a5b6-8213c9501cbc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:13.107297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0f4fbf8-481d-4df3-a5b6-8213c9501cbc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:13.107859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0f4fbf8-481d-4df3-a5b6-8213c9501cbc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:13.108896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0f4fbf8-481d-4df3-a5b6-8213c9501cbc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:13.109417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0f4fbf8-481d-4df3-a5b6-8213c9501cbc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:13.174969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d0f4fbf8-481d-4df3-a5b6-8213c9501cbc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:13.183189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d0f4fbf8-481d-4df3-a5b6-8213c9501cbc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1239 microversion: 2.1 time: 0.090822 Nov 08 17:39:13.183785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 50/93] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:13 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:13.569775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-15080e26-ebf1-4ddc-bbec-f0fe14d4d6d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:13.571011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-15080e26-ebf1-4ddc-bbec-f0fe14d4d6d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:13.578678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15080e26-ebf1-4ddc-bbec-f0fe14d4d6d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:13.579094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15080e26-ebf1-4ddc-bbec-f0fe14d4d6d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:13.580181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15080e26-ebf1-4ddc-bbec-f0fe14d4d6d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:13.580602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15080e26-ebf1-4ddc-bbec-f0fe14d4d6d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:13.795666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:13.796346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:13.815779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:13.816283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:13.817432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:13.822520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:13.931423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-15080e26-ebf1-4ddc-bbec-f0fe14d4d6d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:13.942929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-15080e26-ebf1-4ddc-bbec-f0fe14d4d6d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.373292 Nov 08 17:39:13.943568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 44/94] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:13 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:13.952187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-07997ded-ac9e-4bf3-a73a-384b21dc50ad tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:13.952804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-07997ded-ac9e-4bf3-a73a-384b21dc50ad tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:13.964368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-07997ded-ac9e-4bf3-a73a-384b21dc50ad tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:13.964839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-07997ded-ac9e-4bf3-a73a-384b21dc50ad tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:13.965632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-07997ded-ac9e-4bf3-a73a-384b21dc50ad tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:13.966060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-07997ded-ac9e-4bf3-a73a-384b21dc50ad tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:14.001933 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:14.018949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:14.025625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:14.028422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5fb069cc-67de-4182-816e-101014b10a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1276 microversion: 2.20 time: 0.239338 Nov 08 17:39:14.032263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 51/95] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:14.203192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-787d3b79-7d22-4eea-8804-8d0c595abff4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:14.204937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-787d3b79-7d22-4eea-8804-8d0c595abff4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:14.213486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-787d3b79-7d22-4eea-8804-8d0c595abff4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:14.213977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-787d3b79-7d22-4eea-8804-8d0c595abff4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:14.214794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-787d3b79-7d22-4eea-8804-8d0c595abff4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:14.215282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-787d3b79-7d22-4eea-8804-8d0c595abff4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:14.361556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-787d3b79-7d22-4eea-8804-8d0c595abff4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:14.377649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-787d3b79-7d22-4eea-8804-8d0c595abff4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1231 microversion: 2.1 time: 0.173569 Nov 08 17:39:14.378669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 52/96] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:14 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1231 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:14.510304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-07997ded-ac9e-4bf3-a73a-384b21dc50ad tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:14.516093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-07997ded-ac9e-4bf3-a73a-384b21dc50ad tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.571003 Nov 08 17:39:14.516754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 45/97] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:13 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:14.962603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ba302f84-1c28-4c2d-a664-e32048858446 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:14.964465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ba302f84-1c28-4c2d-a664-e32048858446 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:14.971572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba302f84-1c28-4c2d-a664-e32048858446 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:14.972266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba302f84-1c28-4c2d-a664-e32048858446 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:14.994006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba302f84-1c28-4c2d-a664-e32048858446 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:15.000027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba302f84-1c28-4c2d-a664-e32048858446 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:15.057978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:15.059824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:15.074645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:15.075645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:15.076677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:15.079060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:15.413675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:15.423577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:15.423920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:15.425231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5679408b-1213-44b9-a2c3-4d4fa2b8f39b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1350 microversion: 2.20 time: 0.374943 Nov 08 17:39:15.426336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 46/98] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1350 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:15.430914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-453d92e5-0d65-435c-abbf-0d0b1f07e816 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:15.431718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-453d92e5-0d65-435c-abbf-0d0b1f07e816 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:15.437790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-453d92e5-0d65-435c-abbf-0d0b1f07e816 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:15.438475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-453d92e5-0d65-435c-abbf-0d0b1f07e816 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:15.439528 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-453d92e5-0d65-435c-abbf-0d0b1f07e816 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:15.440180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-453d92e5-0d65-435c-abbf-0d0b1f07e816 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:15.572610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-453d92e5-0d65-435c-abbf-0d0b1f07e816 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:15.588430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-453d92e5-0d65-435c-abbf-0d0b1f07e816 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1295 microversion: 2.1 time: 0.160799 Nov 08 17:39:15.600058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:15 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1295 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:15.612205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5bc5d7c7-2a4f-40fd-a477-03b521f8e602 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:15.613494 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5bc5d7c7-2a4f-40fd-a477-03b521f8e602 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:15.630376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5bc5d7c7-2a4f-40fd-a477-03b521f8e602 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:15.631603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5bc5d7c7-2a4f-40fd-a477-03b521f8e602 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:15.633288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5bc5d7c7-2a4f-40fd-a477-03b521f8e602 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:15.635649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5bc5d7c7-2a4f-40fd-a477-03b521f8e602 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:15.818174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ba302f84-1c28-4c2d-a664-e32048858446 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:15.828455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ba302f84-1c28-4c2d-a664-e32048858446 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.871113 Nov 08 17:39:15.828967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 53/100] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:14 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:16.272210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-3d11fef4-627c-4089-9416-41519a9cfb45 req-f63e6958-7e15-42ac-a857-52735f91956d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fce4e35-eea4-4afa-8842-ca97bcde50b8", "tag": "68acbcbe-f5ac-4ddb-b8d8-a5f13cd9ff20"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:16.274544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:16.274544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:16.285729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-3d11fef4-627c-4089-9416-41519a9cfb45 req-f63e6958-7e15-42ac-a857-52735f91956d service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.286851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-3d11fef4-627c-4089-9416-41519a9cfb45 req-f63e6958-7e15-42ac-a857-52735f91956d service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.308833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-3d11fef4-627c-4089-9416-41519a9cfb45 req-f63e6958-7e15-42ac-a857-52735f91956d service nova] Creating event network-changed:68acbcbe-f5ac-4ddb-b8d8-a5f13cd9ff20 for instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 on hv-cinder-81689 Nov 08 17:39:16.310767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-3d11fef4-627c-4089-9416-41519a9cfb45 req-f63e6958-7e15-42ac-a857-52735f91956d service nova] Acquired lock "compute-rpcapi-router" {{(pid=127762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 08 17:39:16.312102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-783e3560-3619-4334-9848-02aeac3df771 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.312748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-783e3560-3619-4334-9848-02aeac3df771 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.313749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-783e3560-3619-4334-9848-02aeac3df771 None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.314343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-783e3560-3619-4334-9848-02aeac3df771 None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.327652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.compute.rpcapi [None req-783e3560-3619-4334-9848-02aeac3df771 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 08 17:39:16.329085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-783e3560-3619-4334-9848-02aeac3df771 None None] Releasing lock "compute-rpcapi-router" {{(pid=127762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 08 17:39:16.371511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-783e3560-3619-4334-9848-02aeac3df771 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182241 Nov 08 17:39:16.372233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 54/101] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:39:16.434355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5bc5d7c7-2a4f-40fd-a477-03b521f8e602 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:16.445663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5bc5d7c7-2a4f-40fd-a477-03b521f8e602 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.844199 Nov 08 17:39:16.447224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 48/102] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:15 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:16.448109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:16.449041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:16.457664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.458328 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.459508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.460162 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.617774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c01e227b-43b7-49df-b315-dbe0169529a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:16.618667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c01e227b-43b7-49df-b315-dbe0169529a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:16.626031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c01e227b-43b7-49df-b315-dbe0169529a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.626725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c01e227b-43b7-49df-b315-dbe0169529a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.627738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c01e227b-43b7-49df-b315-dbe0169529a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.628251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c01e227b-43b7-49df-b315-dbe0169529a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.779889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c01e227b-43b7-49df-b315-dbe0169529a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:16.788954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c01e227b-43b7-49df-b315-dbe0169529a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1293 microversion: 2.1 time: 0.175340 Nov 08 17:39:16.806018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 49/103] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:16 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1293 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:16.846723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ee7be538-8951-406a-bbed-b6c3bb1e2926 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:16.847634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ee7be538-8951-406a-bbed-b6c3bb1e2926 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:16.855240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee7be538-8951-406a-bbed-b6c3bb1e2926 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.856125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee7be538-8951-406a-bbed-b6c3bb1e2926 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.857345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee7be538-8951-406a-bbed-b6c3bb1e2926 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:16.858190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee7be538-8951-406a-bbed-b6c3bb1e2926 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:16.916289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:16.935806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:16.937310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:16.938499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ba97ca43-0de0-4923-8293-183b9bd88229 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.497504 Nov 08 17:39:16.939067 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 55/104] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:39:17.328431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ee7be538-8951-406a-bbed-b6c3bb1e2926 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:17.337972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ee7be538-8951-406a-bbed-b6c3bb1e2926 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.496486 Nov 08 17:39:17.346663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 50/105] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:16 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:17.463555 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-277be41c-9647-4fbb-b45e-aad400e48073 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:17.464773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-277be41c-9647-4fbb-b45e-aad400e48073 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:17.472610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-277be41c-9647-4fbb-b45e-aad400e48073 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:17.473896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-277be41c-9647-4fbb-b45e-aad400e48073 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:17.475163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-277be41c-9647-4fbb-b45e-aad400e48073 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:17.475990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-277be41c-9647-4fbb-b45e-aad400e48073 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:17.809613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-12f66cf2-1f06-4b1f-a466-dc1e59e07574 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:17.810235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-12f66cf2-1f06-4b1f-a466-dc1e59e07574 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:17.825538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-12f66cf2-1f06-4b1f-a466-dc1e59e07574 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:17.826243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-12f66cf2-1f06-4b1f-a466-dc1e59e07574 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:17.827229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-12f66cf2-1f06-4b1f-a466-dc1e59e07574 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:17.827650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-12f66cf2-1f06-4b1f-a466-dc1e59e07574 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:18.055754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-277be41c-9647-4fbb-b45e-aad400e48073 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:18.073471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-277be41c-9647-4fbb-b45e-aad400e48073 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.614122 Nov 08 17:39:18.075787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 56/106] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:17 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:18.091057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:18.095286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:18.103667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:18.104332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:18.105592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:18.106215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:18.172383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-12f66cf2-1f06-4b1f-a466-dc1e59e07574 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:18.183735 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-12f66cf2-1f06-4b1f-a466-dc1e59e07574 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.378133 Nov 08 17:39:18.184906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 51/107] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:17 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:18.361003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9d7b9096-8e81-4e2d-a79b-fca2d2395c93 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:18.361915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9d7b9096-8e81-4e2d-a79b-fca2d2395c93 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:18.371039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:18.378337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d7b9096-8e81-4e2d-a79b-fca2d2395c93 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:18.380271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d7b9096-8e81-4e2d-a79b-fca2d2395c93 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:18.381943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d7b9096-8e81-4e2d-a79b-fca2d2395c93 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:18.382724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:18.383999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d7b9096-8e81-4e2d-a79b-fca2d2395c93 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:18.386079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:18.392308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4f63a213-64de-4c29-9384-099fb907620d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.314459 Nov 08 17:39:18.393070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 57/108] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:18.409056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-bdf01f8b-c9ba-4b6c-8daf-299a6d7eb22a req-de876152-d3bb-4433-a51f-81271a30c430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32522c32-1bb6-42e0-aa78-570cdaebad68", "tag": "26667ea0-97f1-4e86-8cff-b07308a44cf1"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:18.411509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:18.411509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:18.421353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-bdf01f8b-c9ba-4b6c-8daf-299a6d7eb22a req-de876152-d3bb-4433-a51f-81271a30c430 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:18.428257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-bdf01f8b-c9ba-4b6c-8daf-299a6d7eb22a req-de876152-d3bb-4433-a51f-81271a30c430 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:18.451567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-bdf01f8b-c9ba-4b6c-8daf-299a6d7eb22a req-de876152-d3bb-4433-a51f-81271a30c430 service nova] Creating event network-changed:26667ea0-97f1-4e86-8cff-b07308a44cf1 for instance 32522c32-1bb6-42e0-aa78-570cdaebad68 on hv-cinder-81689 Nov 08 17:39:18.462705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-bdf01f8b-c9ba-4b6c-8daf-299a6d7eb22a req-de876152-d3bb-4433-a51f-81271a30c430 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057181 Nov 08 17:39:18.463846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 58/109] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:39:18.982185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-69cabd3d-0a84-49fc-97a8-abddda5b6e98 req-120ee4b1-0779-49ef-8b6d-dc358d4f35c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf21b3ca-51f1-43c5-9b61-78422c205ff1", "tag": "fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:18.984601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:18.984601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:19.001004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-69cabd3d-0a84-49fc-97a8-abddda5b6e98 req-120ee4b1-0779-49ef-8b6d-dc358d4f35c6 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:19.001468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-69cabd3d-0a84-49fc-97a8-abddda5b6e98 req-120ee4b1-0779-49ef-8b6d-dc358d4f35c6 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:19.018754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9d7b9096-8e81-4e2d-a79b-fca2d2395c93 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:19.030046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9d7b9096-8e81-4e2d-a79b-fca2d2395c93 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.673203 Nov 08 17:39:19.031337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 52/110] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:18 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:19.033849 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-69cabd3d-0a84-49fc-97a8-abddda5b6e98 req-120ee4b1-0779-49ef-8b6d-dc358d4f35c6 service nova] Creating event network-changed:fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12 for instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 on hv-cinder-81689 Nov 08 17:39:19.043444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-69cabd3d-0a84-49fc-97a8-abddda5b6e98 req-120ee4b1-0779-49ef-8b6d-dc358d4f35c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190036 Nov 08 17:39:19.046788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 59/111] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:19.098891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-53aa3cb9-3a08-4090-9d78-cc53eae5f964 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:19.102247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-53aa3cb9-3a08-4090-9d78-cc53eae5f964 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:19.107895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53aa3cb9-3a08-4090-9d78-cc53eae5f964 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:19.108768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53aa3cb9-3a08-4090-9d78-cc53eae5f964 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:19.110018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53aa3cb9-3a08-4090-9d78-cc53eae5f964 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:19.110444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53aa3cb9-3a08-4090-9d78-cc53eae5f964 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:19.203402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7cd37897-1145-4247-9e9c-a85acdcd1ea1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:19.204221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7cd37897-1145-4247-9e9c-a85acdcd1ea1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:19.218295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cd37897-1145-4247-9e9c-a85acdcd1ea1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:19.219088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cd37897-1145-4247-9e9c-a85acdcd1ea1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:19.220113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cd37897-1145-4247-9e9c-a85acdcd1ea1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:19.221207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cd37897-1145-4247-9e9c-a85acdcd1ea1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:19.520942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-53aa3cb9-3a08-4090-9d78-cc53eae5f964 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:19.530737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-53aa3cb9-3a08-4090-9d78-cc53eae5f964 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.436249 Nov 08 17:39:19.531402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 53/112] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:19 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:19.536531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:19.537303 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:19.555036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:19.555626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:19.557060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:19.557591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:19.575612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7cd37897-1145-4247-9e9c-a85acdcd1ea1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:19.585534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7cd37897-1145-4247-9e9c-a85acdcd1ea1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.387106 Nov 08 17:39:19.586192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 60/113] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:19 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:19.702811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:19.711548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:19.713018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:19.714098 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f4514101-8bf2-44d2-adfb-320debec5414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.181495 Nov 08 17:39:19.715139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 54/114] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:20.047432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-961414f1-c02e-4e20-8e9a-3263efe0c13e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:20.048392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-961414f1-c02e-4e20-8e9a-3263efe0c13e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:20.057925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-961414f1-c02e-4e20-8e9a-3263efe0c13e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:20.059264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-961414f1-c02e-4e20-8e9a-3263efe0c13e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:20.061611 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-961414f1-c02e-4e20-8e9a-3263efe0c13e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:20.062619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-961414f1-c02e-4e20-8e9a-3263efe0c13e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:20.235195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-961414f1-c02e-4e20-8e9a-3263efe0c13e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:20.246644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-961414f1-c02e-4e20-8e9a-3263efe0c13e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.202614 Nov 08 17:39:20.247176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 61/115] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:20 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:20.550773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f5e11995-236c-4d68-bef5-46b49eb42fa2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:20.554163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f5e11995-236c-4d68-bef5-46b49eb42fa2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:20.561293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5e11995-236c-4d68-bef5-46b49eb42fa2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:20.561736 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5e11995-236c-4d68-bef5-46b49eb42fa2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:20.562551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5e11995-236c-4d68-bef5-46b49eb42fa2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:20.563275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5e11995-236c-4d68-bef5-46b49eb42fa2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:20.602794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9c86067c-5277-4aad-8607-f029dd112e4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:20.603389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9c86067c-5277-4aad-8607-f029dd112e4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:20.609725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c86067c-5277-4aad-8607-f029dd112e4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:20.610164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c86067c-5277-4aad-8607-f029dd112e4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:20.610984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c86067c-5277-4aad-8607-f029dd112e4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:20.611410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c86067c-5277-4aad-8607-f029dd112e4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:20.800110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f5e11995-236c-4d68-bef5-46b49eb42fa2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:20.807480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9c86067c-5277-4aad-8607-f029dd112e4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:20.807806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f5e11995-236c-4d68-bef5-46b49eb42fa2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.263754 Nov 08 17:39:20.808459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 55/116] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:20 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:20.812902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:20.813890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:20.815071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9c86067c-5277-4aad-8607-f029dd112e4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.215888 Nov 08 17:39:20.815629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 62/117] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:20 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:20.820418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:20.820903 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:20.821668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:20.822089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:21.012581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:21.031993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:21.036045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:21.036045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7602a73a-2914-4ced-a5b7-8ff8b2218494 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.225439 Nov 08 17:39:21.036867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 56/118] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:21.065351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-cf5c4f24-c4f7-487d-a657-55d4065d8e40 req-411312e9-1798-46fd-85e5-95746681081c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabb9c79-5e8d-4982-a6eb-4169e2471b27", "tag": "6c56cad9-14a2-4272-bba1-d1d6fca923bd"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:21.073991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:21.073991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:21.075633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-cf5c4f24-c4f7-487d-a657-55d4065d8e40 req-411312e9-1798-46fd-85e5-95746681081c service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:21.076294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-cf5c4f24-c4f7-487d-a657-55d4065d8e40 req-411312e9-1798-46fd-85e5-95746681081c service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:21.087897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-cf5c4f24-c4f7-487d-a657-55d4065d8e40 req-411312e9-1798-46fd-85e5-95746681081c service nova] Creating event network-changed:6c56cad9-14a2-4272-bba1-d1d6fca923bd for instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 on hv-cinder-81689 Nov 08 17:39:21.093281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-cf5c4f24-c4f7-487d-a657-55d4065d8e40 req-411312e9-1798-46fd-85e5-95746681081c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031737 Nov 08 17:39:21.093863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 63/119] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:21.264197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d0a50e82-64e2-46de-8832-55ceb169c3c6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:21.265069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d0a50e82-64e2-46de-8832-55ceb169c3c6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:21.275674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0a50e82-64e2-46de-8832-55ceb169c3c6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:21.276316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0a50e82-64e2-46de-8832-55ceb169c3c6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:21.277155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0a50e82-64e2-46de-8832-55ceb169c3c6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:21.277587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0a50e82-64e2-46de-8832-55ceb169c3c6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:21.463332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d0a50e82-64e2-46de-8832-55ceb169c3c6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:21.470709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d0a50e82-64e2-46de-8832-55ceb169c3c6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.210261 Nov 08 17:39:21.471279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 57/120] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:21 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:21.829399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-77b928bf-1cf8-4a4c-8d2d-fff68d897f3f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:21.830844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-77b928bf-1cf8-4a4c-8d2d-fff68d897f3f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:21.832168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-44a58eab-7ea3-43f3-ab5e-dd5778d0fc93 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:21.833292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-44a58eab-7ea3-43f3-ab5e-dd5778d0fc93 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:21.849175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77b928bf-1cf8-4a4c-8d2d-fff68d897f3f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:21.849175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77b928bf-1cf8-4a4c-8d2d-fff68d897f3f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:21.849175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77b928bf-1cf8-4a4c-8d2d-fff68d897f3f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:21.849398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44a58eab-7ea3-43f3-ab5e-dd5778d0fc93 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:21.849482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77b928bf-1cf8-4a4c-8d2d-fff68d897f3f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:21.849549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44a58eab-7ea3-43f3-ab5e-dd5778d0fc93 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:21.849549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44a58eab-7ea3-43f3-ab5e-dd5778d0fc93 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:21.849549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44a58eab-7ea3-43f3-ab5e-dd5778d0fc93 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:22.061771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-44a58eab-7ea3-43f3-ab5e-dd5778d0fc93 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:22.069226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-44a58eab-7ea3-43f3-ab5e-dd5778d0fc93 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.240642 Nov 08 17:39:22.078710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 58/121] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:21 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:22.078710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:22.080893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-77b928bf-1cf8-4a4c-8d2d-fff68d897f3f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:22.081003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:22.081003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:22.081233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:22.082014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:22.083047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:22.090002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-77b928bf-1cf8-4a4c-8d2d-fff68d897f3f tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.268488 Nov 08 17:39:22.091160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 64/122] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:21 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:22.227869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:22.236759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:22.238264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:22.240128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5d816e34-ca69-41a4-ae39-fbc88c5f4234 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.169398 Nov 08 17:39:22.242567 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 59/123] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:22.489361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ac88437c-6a4d-422e-973a-7b8724707491 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:22.489597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ac88437c-6a4d-422e-973a-7b8724707491 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:22.495717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac88437c-6a4d-422e-973a-7b8724707491 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:22.496147 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac88437c-6a4d-422e-973a-7b8724707491 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:22.496911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac88437c-6a4d-422e-973a-7b8724707491 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:22.497399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac88437c-6a4d-422e-973a-7b8724707491 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:22.649419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ac88437c-6a4d-422e-973a-7b8724707491 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:22.662249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ac88437c-6a4d-422e-973a-7b8724707491 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.177652 Nov 08 17:39:22.662979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 65/124] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:22 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:23.086730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-49ea6883-ee37-49dc-bb44-16c1a4ff4ff8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:23.088268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-49ea6883-ee37-49dc-bb44-16c1a4ff4ff8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:23.099271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49ea6883-ee37-49dc-bb44-16c1a4ff4ff8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.099937 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49ea6883-ee37-49dc-bb44-16c1a4ff4ff8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.103243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49ea6883-ee37-49dc-bb44-16c1a4ff4ff8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.103848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49ea6883-ee37-49dc-bb44-16c1a4ff4ff8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.108036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-393d3563-9f8e-436a-bc5f-96478e24131e tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:23.108850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-393d3563-9f8e-436a-bc5f-96478e24131e tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:23.116072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-393d3563-9f8e-436a-bc5f-96478e24131e tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.116520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-393d3563-9f8e-436a-bc5f-96478e24131e tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.117303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-393d3563-9f8e-436a-bc5f-96478e24131e tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.117726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-393d3563-9f8e-436a-bc5f-96478e24131e tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.338832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-49ea6883-ee37-49dc-bb44-16c1a4ff4ff8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:23.348252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-49ea6883-ee37-49dc-bb44-16c1a4ff4ff8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.265250 Nov 08 17:39:23.349090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 60/125] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:23 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:23.353741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:23.354330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:23.360234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.360950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.361900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.362454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.363949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-393d3563-9f8e-436a-bc5f-96478e24131e tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:23.374132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-393d3563-9f8e-436a-bc5f-96478e24131e tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.270023 Nov 08 17:39:23.374835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 66/126] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:23 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:23.527231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:23.534930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:23.536475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:23.537572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-071d8e5a-cfdd-424d-9f1b-51346c60e16c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.187408 Nov 08 17:39:23.548166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 61/127] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:23.679269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-5791f678-2c54-4826-bc95-72b3578126f7 req-ff55f8cf-0d20-4c2d-bb3f-5b3d54b4e865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fce4e35-eea4-4afa-8842-ca97bcde50b8", "name": "network-vif-plugged", "status": "completed", "tag": "68acbcbe-f5ac-4ddb-b8d8-a5f13cd9ff20"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:23.680424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ea9e065e-a6c7-409e-a5f9-6c1318a23f41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:23.681712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ea9e065e-a6c7-409e-a5f9-6c1318a23f41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:23.683993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:23.683993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:23.688323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea9e065e-a6c7-409e-a5f9-6c1318a23f41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.688873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea9e065e-a6c7-409e-a5f9-6c1318a23f41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.690100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea9e065e-a6c7-409e-a5f9-6c1318a23f41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.692930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea9e065e-a6c7-409e-a5f9-6c1318a23f41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.713775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-5791f678-2c54-4826-bc95-72b3578126f7 req-ff55f8cf-0d20-4c2d-bb3f-5b3d54b4e865 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:23.714578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-5791f678-2c54-4826-bc95-72b3578126f7 req-ff55f8cf-0d20-4c2d-bb3f-5b3d54b4e865 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:23.741641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-5791f678-2c54-4826-bc95-72b3578126f7 req-ff55f8cf-0d20-4c2d-bb3f-5b3d54b4e865 service nova] Creating event network-vif-plugged:68acbcbe-f5ac-4ddb-b8d8-a5f13cd9ff20 for instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 on hv-cinder-81689 Nov 08 17:39:23.750202 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-5791f678-2c54-4826-bc95-72b3578126f7 req-ff55f8cf-0d20-4c2d-bb3f-5b3d54b4e865 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139507 Nov 08 17:39:23.751977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 67/128] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:23.893975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea9e065e-a6c7-409e-a5f9-6c1318a23f41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:23.902832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ea9e065e-a6c7-409e-a5f9-6c1318a23f41 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.227913 Nov 08 17:39:23.903492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 62/129] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:23 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:24.365988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-19393ddf-fbfb-4732-9151-9b9dd70542d9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:24.366707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-19393ddf-fbfb-4732-9151-9b9dd70542d9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:24.373128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19393ddf-fbfb-4732-9151-9b9dd70542d9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:24.373562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19393ddf-fbfb-4732-9151-9b9dd70542d9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:24.374326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19393ddf-fbfb-4732-9151-9b9dd70542d9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:24.374776 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19393ddf-fbfb-4732-9151-9b9dd70542d9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:24.399198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f0cd7205-2542-4f75-9247-c52058b20ed1 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:24.400422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f0cd7205-2542-4f75-9247-c52058b20ed1 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:24.411665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0cd7205-2542-4f75-9247-c52058b20ed1 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:24.412073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0cd7205-2542-4f75-9247-c52058b20ed1 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:24.412877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0cd7205-2542-4f75-9247-c52058b20ed1 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:24.413305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0cd7205-2542-4f75-9247-c52058b20ed1 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:24.550617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-19393ddf-fbfb-4732-9151-9b9dd70542d9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:24.558805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-19393ddf-fbfb-4732-9151-9b9dd70542d9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.197032 Nov 08 17:39:24.568783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 68/130] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:24 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:24.574122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:24.574706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:24.581719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:24.582895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:24.583681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:24.585935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:24.604252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f0cd7205-2542-4f75-9247-c52058b20ed1 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:24.612455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f0cd7205-2542-4f75-9247-c52058b20ed1 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.224808 Nov 08 17:39:24.613029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 63/131] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:24 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:24.740229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:24.748291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:24.749770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:24.750869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ef1b919b-ed3a-43f9-a66d-7e98dea99142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.180935 Nov 08 17:39:24.751418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 69/132] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:24.922916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-786f8c3b-b55c-4ea9-9844-f05953176475 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:24.923759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-786f8c3b-b55c-4ea9-9844-f05953176475 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:24.929728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-786f8c3b-b55c-4ea9-9844-f05953176475 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:24.930165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-786f8c3b-b55c-4ea9-9844-f05953176475 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:24.930960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-786f8c3b-b55c-4ea9-9844-f05953176475 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:24.931384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-786f8c3b-b55c-4ea9-9844-f05953176475 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.063501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-786f8c3b-b55c-4ea9-9844-f05953176475 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:25.071267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-786f8c3b-b55c-4ea9-9844-f05953176475 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.152121 Nov 08 17:39:25.071821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 64/133] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:24 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:25.575444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7414cf28-4dbe-4847-a99d-2c64031dabde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:25.575977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7414cf28-4dbe-4847-a99d-2c64031dabde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:25.581852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7414cf28-4dbe-4847-a99d-2c64031dabde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.582350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7414cf28-4dbe-4847-a99d-2c64031dabde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.583216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7414cf28-4dbe-4847-a99d-2c64031dabde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.583677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7414cf28-4dbe-4847-a99d-2c64031dabde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.630051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-86bebe01-f3ca-4823-907e-43c35a904e57 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:25.630762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-86bebe01-f3ca-4823-907e-43c35a904e57 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:25.636596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86bebe01-f3ca-4823-907e-43c35a904e57 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.637027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86bebe01-f3ca-4823-907e-43c35a904e57 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.637787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86bebe01-f3ca-4823-907e-43c35a904e57 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.638206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86bebe01-f3ca-4823-907e-43c35a904e57 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.767022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7414cf28-4dbe-4847-a99d-2c64031dabde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:25.779316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7414cf28-4dbe-4847-a99d-2c64031dabde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.207577 Nov 08 17:39:25.791312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 70/134] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:25 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:25.797068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:25.797879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:25.804579 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.805324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.806326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.806985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.840990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-86bebe01-f3ca-4823-907e-43c35a904e57 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:25.853038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-86bebe01-f3ca-4823-907e-43c35a904e57 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.226413 Nov 08 17:39:25.853626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 65/135] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:25 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:25.869537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-e32cd024-f5fc-4208-9ad1-326a2943ff6d req-e7fc88f7-2925-4571-b44d-51e80511da4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32522c32-1bb6-42e0-aa78-570cdaebad68", "name": "network-vif-plugged", "status": "completed", "tag": "26667ea0-97f1-4e86-8cff-b07308a44cf1"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:25.871808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:25.871808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:39:25.883012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-e32cd024-f5fc-4208-9ad1-326a2943ff6d req-e7fc88f7-2925-4571-b44d-51e80511da4a service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.883440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-e32cd024-f5fc-4208-9ad1-326a2943ff6d req-e7fc88f7-2925-4571-b44d-51e80511da4a service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.906744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-e32cd024-f5fc-4208-9ad1-326a2943ff6d req-e7fc88f7-2925-4571-b44d-51e80511da4a service nova] Creating event network-vif-plugged:26667ea0-97f1-4e86-8cff-b07308a44cf1 for instance 32522c32-1bb6-42e0-aa78-570cdaebad68 on hv-cinder-81689 Nov 08 17:39:25.907338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-e32cd024-f5fc-4208-9ad1-326a2943ff6d req-e7fc88f7-2925-4571-b44d-51e80511da4a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127763) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 08 17:39:25.908424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c0060ad-8390-4340-9b4d-20f1aef628ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.909478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c0060ad-8390-4340-9b4d-20f1aef628ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.910301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c0060ad-8390-4340-9b4d-20f1aef628ea None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:25.910745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c0060ad-8390-4340-9b4d-20f1aef628ea None None] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:25.919629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.compute.rpcapi [None req-9c0060ad-8390-4340-9b4d-20f1aef628ea None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 08 17:39:25.920797 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c0060ad-8390-4340-9b4d-20f1aef628ea None None] Releasing lock "compute-rpcapi-router" {{(pid=127763) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 08 17:39:25.946091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9c0060ad-8390-4340-9b4d-20f1aef628ea None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081527 Nov 08 17:39:25.946843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 66/136] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:25.956818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:25.964643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:25.966125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:25.967225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d680b3d3-eea7-423e-b5f6-5da0bd6c996e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.174703 Nov 08 17:39:25.967767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 71/137] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:26.088358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-02ec1363-338f-4e44-9a4b-801b91ee813c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:26.089041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-02ec1363-338f-4e44-9a4b-801b91ee813c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:26.094932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02ec1363-338f-4e44-9a4b-801b91ee813c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:26.095368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02ec1363-338f-4e44-9a4b-801b91ee813c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:26.096152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02ec1363-338f-4e44-9a4b-801b91ee813c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:26.096571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02ec1363-338f-4e44-9a4b-801b91ee813c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:26.224905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-02ec1363-338f-4e44-9a4b-801b91ee813c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:26.232342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-02ec1363-338f-4e44-9a4b-801b91ee813c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.147984 Nov 08 17:39:26.232893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 67/138] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:26 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:26.802072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e910d5b6-5057-42c9-bd17-6e656128b478 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:26.802693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e910d5b6-5057-42c9-bd17-6e656128b478 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:26.808986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e910d5b6-5057-42c9-bd17-6e656128b478 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:26.809736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e910d5b6-5057-42c9-bd17-6e656128b478 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:26.810192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e910d5b6-5057-42c9-bd17-6e656128b478 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:26.810675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e910d5b6-5057-42c9-bd17-6e656128b478 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:26.870309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-400f9bb7-c5b8-47d1-842f-c32a7de7920d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:26.872617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-400f9bb7-c5b8-47d1-842f-c32a7de7920d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:26.883180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-400f9bb7-c5b8-47d1-842f-c32a7de7920d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:26.883747 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-400f9bb7-c5b8-47d1-842f-c32a7de7920d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:26.887796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-400f9bb7-c5b8-47d1-842f-c32a7de7920d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:26.888346 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-400f9bb7-c5b8-47d1-842f-c32a7de7920d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:27.240427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e910d5b6-5057-42c9-bd17-6e656128b478 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:27.250352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e910d5b6-5057-42c9-bd17-6e656128b478 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.452013 Nov 08 17:39:27.250975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:26 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:27.256564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:27.257494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:27.263778 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:27.264233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:27.265007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:27.265435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:27.309804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-400f9bb7-c5b8-47d1-842f-c32a7de7920d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:27.317908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-400f9bb7-c5b8-47d1-842f-c32a7de7920d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.452047 Nov 08 17:39:27.318507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 68/140] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:26 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:27.323132 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e6464f84-6a65-4f79-90b8-4dfcb0d71504 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:27.323886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e6464f84-6a65-4f79-90b8-4dfcb0d71504 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:27.330284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e6464f84-6a65-4f79-90b8-4dfcb0d71504 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:27.330766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e6464f84-6a65-4f79-90b8-4dfcb0d71504 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:27.331580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e6464f84-6a65-4f79-90b8-4dfcb0d71504 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:27.332044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e6464f84-6a65-4f79-90b8-4dfcb0d71504 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:27.445561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:27.453567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:27.455111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:27.456205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e8b5c845-4026-4172-94c8-fab9ddebaf2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.204058 Nov 08 17:39:27.456766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 73/141] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:27.491522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e6464f84-6a65-4f79-90b8-4dfcb0d71504 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:27.499131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e6464f84-6a65-4f79-90b8-4dfcb0d71504 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.179430 Nov 08 17:39:27.499657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 69/142] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:27 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:28.267809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b3664f4f-796c-48cf-8599-2a0d980d89dc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:28.268413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b3664f4f-796c-48cf-8599-2a0d980d89dc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:28.274763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3664f4f-796c-48cf-8599-2a0d980d89dc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:28.275204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3664f4f-796c-48cf-8599-2a0d980d89dc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:28.275963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3664f4f-796c-48cf-8599-2a0d980d89dc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:28.276390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3664f4f-796c-48cf-8599-2a0d980d89dc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:28.335869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9c86c638-5f77-4ad5-bf3e-fa07d0e41269 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:28.336479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9c86c638-5f77-4ad5-bf3e-fa07d0e41269 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:28.346089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c86c638-5f77-4ad5-bf3e-fa07d0e41269 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:28.346566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c86c638-5f77-4ad5-bf3e-fa07d0e41269 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:28.347358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c86c638-5f77-4ad5-bf3e-fa07d0e41269 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:28.347970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c86c638-5f77-4ad5-bf3e-fa07d0e41269 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:28.426619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b3664f4f-796c-48cf-8599-2a0d980d89dc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:28.435351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b3664f4f-796c-48cf-8599-2a0d980d89dc tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.171050 Nov 08 17:39:28.445856 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 74/143] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:28 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:28.474220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:28.474852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:28.480546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:28.480987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:28.481761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:28.482179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:28.499444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9c86c638-5f77-4ad5-bf3e-fa07d0e41269 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:28.507298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9c86c638-5f77-4ad5-bf3e-fa07d0e41269 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.176536 Nov 08 17:39:28.507920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 70/144] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:28 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:28.515442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2aaeabc1-5621-43ae-971a-2439891c94f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:28.516046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2aaeabc1-5621-43ae-971a-2439891c94f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:28.522769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2aaeabc1-5621-43ae-971a-2439891c94f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:28.523206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2aaeabc1-5621-43ae-971a-2439891c94f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:28.523969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2aaeabc1-5621-43ae-971a-2439891c94f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:28.524391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2aaeabc1-5621-43ae-971a-2439891c94f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:28.653421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:28.662665 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:28.664183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:28.665269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ed0c46d0-d419-430b-858a-4353e72910b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.194868 Nov 08 17:39:28.665819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 75/145] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:39:28.697656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2aaeabc1-5621-43ae-971a-2439891c94f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:28.709781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2aaeabc1-5621-43ae-971a-2439891c94f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.193140 Nov 08 17:39:28.709781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 71/146] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:28 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:29.452774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-82517742-aaa4-4acb-920d-aa29a117f8c7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:29.453378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-82517742-aaa4-4acb-920d-aa29a117f8c7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:29.459996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-82517742-aaa4-4acb-920d-aa29a117f8c7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:29.460440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-82517742-aaa4-4acb-920d-aa29a117f8c7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:29.461207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-82517742-aaa4-4acb-920d-aa29a117f8c7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:29.461637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-82517742-aaa4-4acb-920d-aa29a117f8c7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:29.524309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-73710e34-06ce-4758-be5c-1d662a1bcf17 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:29.524916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-73710e34-06ce-4758-be5c-1d662a1bcf17 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:29.530584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73710e34-06ce-4758-be5c-1d662a1bcf17 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:29.531024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73710e34-06ce-4758-be5c-1d662a1bcf17 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:29.531777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73710e34-06ce-4758-be5c-1d662a1bcf17 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:29.532197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73710e34-06ce-4758-be5c-1d662a1bcf17 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:29.617251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-82517742-aaa4-4acb-920d-aa29a117f8c7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:29.625641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-82517742-aaa4-4acb-920d-aa29a117f8c7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.176470 Nov 08 17:39:29.626728 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 76/147] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:29 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:29.682899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-73710e34-06ce-4758-be5c-1d662a1bcf17 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:29.684036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:29.685035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:29.690093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-73710e34-06ce-4758-be5c-1d662a1bcf17 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.169751 Nov 08 17:39:29.690649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:29.691084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:29.691293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 72/148] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:29 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:29.692536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:29.692962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:29.724505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f1a6ca47-cdb9-4f35-861c-1843e02e9e10 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:29.725034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f1a6ca47-cdb9-4f35-861c-1843e02e9e10 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:29.730860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1a6ca47-cdb9-4f35-861c-1843e02e9e10 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:29.731302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1a6ca47-cdb9-4f35-861c-1843e02e9e10 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:29.732076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1a6ca47-cdb9-4f35-861c-1843e02e9e10 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:29.732523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1a6ca47-cdb9-4f35-861c-1843e02e9e10 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:29.843899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:29.852104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:29.853583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:29.854729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3739cd7f-bf82-4d71-b4be-57b6a900e13f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.175040 Nov 08 17:39:29.855282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 77/149] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:39:29.899073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f1a6ca47-cdb9-4f35-861c-1843e02e9e10 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:29.906371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f1a6ca47-cdb9-4f35-861c-1843e02e9e10 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.185771 Nov 08 17:39:29.906956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 73/150] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:29 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:30.641947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-915fcc64-6d21-48dc-9952-9a03ffff137d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:30.642573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-915fcc64-6d21-48dc-9952-9a03ffff137d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:30.649390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-915fcc64-6d21-48dc-9952-9a03ffff137d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:30.649641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-915fcc64-6d21-48dc-9952-9a03ffff137d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:30.650394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-915fcc64-6d21-48dc-9952-9a03ffff137d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:30.650846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-915fcc64-6d21-48dc-9952-9a03ffff137d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:30.706214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9fdfe042-86eb-4115-b5fc-03cc5b48a8ba tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:30.706877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9fdfe042-86eb-4115-b5fc-03cc5b48a8ba tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:30.712816 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9fdfe042-86eb-4115-b5fc-03cc5b48a8ba tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:30.713255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9fdfe042-86eb-4115-b5fc-03cc5b48a8ba tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:30.714020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9fdfe042-86eb-4115-b5fc-03cc5b48a8ba tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:30.714444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9fdfe042-86eb-4115-b5fc-03cc5b48a8ba tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:30.811221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-915fcc64-6d21-48dc-9952-9a03ffff137d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:30.818389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-915fcc64-6d21-48dc-9952-9a03ffff137d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.180134 Nov 08 17:39:30.818982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 78/151] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:30 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:30.873325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:30.874023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:30.875387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9fdfe042-86eb-4115-b5fc-03cc5b48a8ba tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:30.880066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:30.880577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:30.881419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:30.881916 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:30.882538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9fdfe042-86eb-4115-b5fc-03cc5b48a8ba tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.179950 Nov 08 17:39:30.883104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 74/152] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:30 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:30.923626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f3634ac6-3201-4196-8afc-44867c871b8f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:30.924095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f3634ac6-3201-4196-8afc-44867c871b8f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:30.930281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f3634ac6-3201-4196-8afc-44867c871b8f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:30.930739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f3634ac6-3201-4196-8afc-44867c871b8f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:30.931499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f3634ac6-3201-4196-8afc-44867c871b8f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:30.931919 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f3634ac6-3201-4196-8afc-44867c871b8f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:31.047465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:31.055411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:31.056890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:31.057968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2239ae11-9833-41c8-bbcc-8d1f6adc4629 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.188454 Nov 08 17:39:31.058547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 79/153] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:39:31.090363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f3634ac6-3201-4196-8afc-44867c871b8f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:31.098003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f3634ac6-3201-4196-8afc-44867c871b8f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.178064 Nov 08 17:39:31.099276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 75/154] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:30 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:31.835098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-26302df9-03ff-4fc3-a2d7-1a71c6db110e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:31.835698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-26302df9-03ff-4fc3-a2d7-1a71c6db110e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:31.841421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26302df9-03ff-4fc3-a2d7-1a71c6db110e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:31.841859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26302df9-03ff-4fc3-a2d7-1a71c6db110e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:31.842642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26302df9-03ff-4fc3-a2d7-1a71c6db110e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:31.843072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26302df9-03ff-4fc3-a2d7-1a71c6db110e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:31.899503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f5d1e868-a8ae-4044-baa1-ebcc185b3674 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:31.900110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f5d1e868-a8ae-4044-baa1-ebcc185b3674 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:31.905816 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5d1e868-a8ae-4044-baa1-ebcc185b3674 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:31.906263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5d1e868-a8ae-4044-baa1-ebcc185b3674 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:31.907068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5d1e868-a8ae-4044-baa1-ebcc185b3674 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:31.907501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5d1e868-a8ae-4044-baa1-ebcc185b3674 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:31.997315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26302df9-03ff-4fc3-a2d7-1a71c6db110e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:32.006028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-26302df9-03ff-4fc3-a2d7-1a71c6db110e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.174671 Nov 08 17:39:32.006636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 80/155] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:31 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:32.061570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f5d1e868-a8ae-4044-baa1-ebcc185b3674 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:32.069832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f5d1e868-a8ae-4044-baa1-ebcc185b3674 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.174450 Nov 08 17:39:32.070342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 76/156] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:31 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:32.074937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:32.075540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:32.081483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:32.081919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:32.083490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:32.083934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:32.115475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-59a3485c-8207-48f6-9409-4fe0e8d62b81 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:32.116179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-59a3485c-8207-48f6-9409-4fe0e8d62b81 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:32.122510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-59a3485c-8207-48f6-9409-4fe0e8d62b81 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:32.122955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-59a3485c-8207-48f6-9409-4fe0e8d62b81 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:32.123735 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-59a3485c-8207-48f6-9409-4fe0e8d62b81 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:32.124161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-59a3485c-8207-48f6-9409-4fe0e8d62b81 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:32.258736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:32.266779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:32.268387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:32.269552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ea55d8ee-0f4f-4d38-8c4d-bdcb4b351bc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.198304 Nov 08 17:39:32.270198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 81/157] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:39:32.301818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-59a3485c-8207-48f6-9409-4fe0e8d62b81 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:32.308948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-59a3485c-8207-48f6-9409-4fe0e8d62b81 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.197666 Nov 08 17:39:32.309509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 77/158] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:32 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:33.023083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-41edceb1-9327-4fd8-8770-374bd7018862 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:33.023692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-41edceb1-9327-4fd8-8770-374bd7018862 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:33.029535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41edceb1-9327-4fd8-8770-374bd7018862 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:33.030002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41edceb1-9327-4fd8-8770-374bd7018862 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:33.030802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41edceb1-9327-4fd8-8770-374bd7018862 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:33.031234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41edceb1-9327-4fd8-8770-374bd7018862 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:33.086933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d95ec5c4-f564-4a24-ba25-714be8f59c92 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:33.087549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d95ec5c4-f564-4a24-ba25-714be8f59c92 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:33.093709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d95ec5c4-f564-4a24-ba25-714be8f59c92 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:33.098005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d95ec5c4-f564-4a24-ba25-714be8f59c92 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:33.098005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d95ec5c4-f564-4a24-ba25-714be8f59c92 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:33.098005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d95ec5c4-f564-4a24-ba25-714be8f59c92 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:33.205437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41edceb1-9327-4fd8-8770-374bd7018862 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:33.213229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-41edceb1-9327-4fd8-8770-374bd7018862 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.194310 Nov 08 17:39:33.213802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 82/159] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:33 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:33.248921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d95ec5c4-f564-4a24-ba25-714be8f59c92 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:33.256687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d95ec5c4-f564-4a24-ba25-714be8f59c92 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.174119 Nov 08 17:39:33.257459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 78/160] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:33 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:33.289036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:33.289642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:33.295710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:33.296157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:33.296939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:33.297364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:33.325787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-04e80e0f-4f6c-4fa2-8633-066e2711b5dd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:33.326421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-04e80e0f-4f6c-4fa2-8633-066e2711b5dd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:33.332108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04e80e0f-4f6c-4fa2-8633-066e2711b5dd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:33.332581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04e80e0f-4f6c-4fa2-8633-066e2711b5dd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:33.333910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04e80e0f-4f6c-4fa2-8633-066e2711b5dd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:33.334407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04e80e0f-4f6c-4fa2-8633-066e2711b5dd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:33.464561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:33.472835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:33.475486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:33.476619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d5801a6e-ed53-4b82-9fce-612668577942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.192322 Nov 08 17:39:33.477419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 83/161] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:33.507413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-04e80e0f-4f6c-4fa2-8633-066e2711b5dd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:33.514694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-04e80e0f-4f6c-4fa2-8633-066e2711b5dd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1317 microversion: 2.1 time: 0.192449 Nov 08 17:39:33.515265 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 79/162] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:33 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:34.189580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-1d506d94-8f61-4fe4-aaba-5ed7f4057230 req-5c0972b9-5e54-455e-8f61-3c9e0ca0e92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabb9c79-5e8d-4982-a6eb-4169e2471b27", "name": "network-vif-plugged", "status": "completed", "tag": "6c56cad9-14a2-4272-bba1-d1d6fca923bd"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:34.191726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:34.191726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:34.202978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-1d506d94-8f61-4fe4-aaba-5ed7f4057230 req-5c0972b9-5e54-455e-8f61-3c9e0ca0e92b service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.203409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-1d506d94-8f61-4fe4-aaba-5ed7f4057230 req-5c0972b9-5e54-455e-8f61-3c9e0ca0e92b service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.214571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-1d506d94-8f61-4fe4-aaba-5ed7f4057230 req-5c0972b9-5e54-455e-8f61-3c9e0ca0e92b service nova] Creating event network-vif-plugged:6c56cad9-14a2-4272-bba1-d1d6fca923bd for instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 on hv-cinder-81689 Nov 08 17:39:34.220033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-1d506d94-8f61-4fe4-aaba-5ed7f4057230 req-5c0972b9-5e54-455e-8f61-3c9e0ca0e92b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034286 Nov 08 17:39:34.220978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 84/163] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:34.230577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6e90c88d-62d8-4c0d-900c-0b3c855e28fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:34.231556 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6e90c88d-62d8-4c0d-900c-0b3c855e28fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:34.238059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e90c88d-62d8-4c0d-900c-0b3c855e28fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.238549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e90c88d-62d8-4c0d-900c-0b3c855e28fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.240115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e90c88d-62d8-4c0d-900c-0b3c855e28fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.240718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e90c88d-62d8-4c0d-900c-0b3c855e28fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.275480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fccf3c6f-74ab-4cec-a66d-64ce7b60a1d3 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:34.276322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fccf3c6f-74ab-4cec-a66d-64ce7b60a1d3 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:34.293656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fccf3c6f-74ab-4cec-a66d-64ce7b60a1d3 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.294725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fccf3c6f-74ab-4cec-a66d-64ce7b60a1d3 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.296196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fccf3c6f-74ab-4cec-a66d-64ce7b60a1d3 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.304053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fccf3c6f-74ab-4cec-a66d-64ce7b60a1d3 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.511604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6e90c88d-62d8-4c0d-900c-0b3c855e28fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:34.519908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6e90c88d-62d8-4c0d-900c-0b3c855e28fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.294052 Nov 08 17:39:34.520670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 80/164] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:34 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:34.526286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:34.527749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:34.535142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.535609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.537613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.538865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.633571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fccf3c6f-74ab-4cec-a66d-64ce7b60a1d3 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:34.638126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fccf3c6f-74ab-4cec-a66d-64ce7b60a1d3 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1315 microversion: 2.1 time: 0.368479 Nov 08 17:39:34.641786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 85/165] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:34 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:34.649900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-41d30cb5-6c50-4767-a5c8-5c7eff0f9463 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:34.655707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-41d30cb5-6c50-4767-a5c8-5c7eff0f9463 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:34.667445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41d30cb5-6c50-4767-a5c8-5c7eff0f9463 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.668561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41d30cb5-6c50-4767-a5c8-5c7eff0f9463 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.672664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41d30cb5-6c50-4767-a5c8-5c7eff0f9463 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:34.673335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41d30cb5-6c50-4767-a5c8-5c7eff0f9463 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:34.764254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:34.776087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:34.777755 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:34.779169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-777d9840-f7b3-4bb6-ab74-762f10ecad4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.257184 Nov 08 17:39:34.779752 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 81/166] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:34.880752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41d30cb5-6c50-4767-a5c8-5c7eff0f9463 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:34.889661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-41d30cb5-6c50-4767-a5c8-5c7eff0f9463 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1507 microversion: 2.1 time: 0.246648 Nov 08 17:39:34.891180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 86/167] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:34 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:35.538043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-800ff86a-8a25-4d2a-bb53-b87653babd91 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:35.539194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-800ff86a-8a25-4d2a-bb53-b87653babd91 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:35.545024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-800ff86a-8a25-4d2a-bb53-b87653babd91 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:35.545663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-800ff86a-8a25-4d2a-bb53-b87653babd91 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:35.546440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-800ff86a-8a25-4d2a-bb53-b87653babd91 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:35.546888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-800ff86a-8a25-4d2a-bb53-b87653babd91 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:35.657027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fa7963f4-95c3-4c3d-ad94-e70d95a3214d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:35.657862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fa7963f4-95c3-4c3d-ad94-e70d95a3214d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:35.665320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fa7963f4-95c3-4c3d-ad94-e70d95a3214d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:35.665847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fa7963f4-95c3-4c3d-ad94-e70d95a3214d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:35.666729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fa7963f4-95c3-4c3d-ad94-e70d95a3214d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:35.667425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fa7963f4-95c3-4c3d-ad94-e70d95a3214d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:35.701316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-800ff86a-8a25-4d2a-bb53-b87653babd91 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:35.709754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-800ff86a-8a25-4d2a-bb53-b87653babd91 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1361 microversion: 2.1 time: 0.176443 Nov 08 17:39:35.714566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 82/168] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:35 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:35.797540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:35.798385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:35.804222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:35.804657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:35.804775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fa7963f4-95c3-4c3d-ad94-e70d95a3214d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:35.805424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:35.805841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:35.812275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fa7963f4-95c3-4c3d-ad94-e70d95a3214d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1502 microversion: 2.1 time: 0.158954 Nov 08 17:39:35.814790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 87/169] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:35 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:35.958328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:35.966896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:35.969033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:35.970378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-39681934-6bbe-43df-a640-aa56ce3d37e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.176998 Nov 08 17:39:35.971054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 83/170] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:39:36.236131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-d0da71e5-e25a-4e8c-96a2-7086663a75c7 req-43a57c10-a2aa-471f-b7c8-c6d98994c256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf21b3ca-51f1-43c5-9b61-78422c205ff1", "name": "network-vif-plugged", "status": "completed", "tag": "fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:36.237702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:36.237702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:36.245068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-d0da71e5-e25a-4e8c-96a2-7086663a75c7 req-43a57c10-a2aa-471f-b7c8-c6d98994c256 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:36.245505 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-d0da71e5-e25a-4e8c-96a2-7086663a75c7 req-43a57c10-a2aa-471f-b7c8-c6d98994c256 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:36.256847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-d0da71e5-e25a-4e8c-96a2-7086663a75c7 req-43a57c10-a2aa-471f-b7c8-c6d98994c256 service nova] Creating event network-vif-plugged:fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12 for instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 on hv-cinder-81689 Nov 08 17:39:36.261478 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-d0da71e5-e25a-4e8c-96a2-7086663a75c7 req-43a57c10-a2aa-471f-b7c8-c6d98994c256 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029027 Nov 08 17:39:36.262066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 88/171] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:36.686994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-888e3420-336d-4837-8795-64eb69f1e954 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c13a92c-2c7b-4f53-a2e1-af7e495bf979"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:36.692783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-888e3420-336d-4837-8795-64eb69f1e954 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:36.699589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888e3420-336d-4837-8795-64eb69f1e954 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:36.700225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888e3420-336d-4837-8795-64eb69f1e954 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:36.701012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888e3420-336d-4837-8795-64eb69f1e954 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:36.701595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888e3420-336d-4837-8795-64eb69f1e954 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:36.729339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-780997aa-47c1-4380-a10d-b663a6b56f9b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:36.730026 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-780997aa-47c1-4380-a10d-b663a6b56f9b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:36.738141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-780997aa-47c1-4380-a10d-b663a6b56f9b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:36.738958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-780997aa-47c1-4380-a10d-b663a6b56f9b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:36.740341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-780997aa-47c1-4380-a10d-b663a6b56f9b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:36.741310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-780997aa-47c1-4380-a10d-b663a6b56f9b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:36.940874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-780997aa-47c1-4380-a10d-b663a6b56f9b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:36.949714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-780997aa-47c1-4380-a10d-b663a6b56f9b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1548 microversion: 2.1 time: 0.224204 Nov 08 17:39:36.962645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 89/172] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:36 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:36.979587 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3f22750f-06f2-4600-8012-caf0cd1a7dbf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:36.980314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3f22750f-06f2-4600-8012-caf0cd1a7dbf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:36.987572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f22750f-06f2-4600-8012-caf0cd1a7dbf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:36.988011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f22750f-06f2-4600-8012-caf0cd1a7dbf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:36.988777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f22750f-06f2-4600-8012-caf0cd1a7dbf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:36.989760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f22750f-06f2-4600-8012-caf0cd1a7dbf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:37.117188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3f22750f-06f2-4600-8012-caf0cd1a7dbf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141178 Nov 08 17:39:37.117793 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 90/173] 10.222.0.18 () {58 vars in 1274 bytes} [Mon Nov 8 17:39:36 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:37.122514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:37.123125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:37.134788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:37.134788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:37.134788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:37.134788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:37.465145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:37.473020 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:37.475716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:37.477294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cc427548-d3de-4cdc-abd5-fdac3f430c90 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1405 microversion: 2.20 time: 0.358259 Nov 08 17:39:37.478048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 91/174] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:37.788558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-100b3a1e-3e4c-4766-8e91-0df9196e8f27 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e273ec1-1abe-4e80-944d-bfe87f3cf4ba"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:37.789704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-100b3a1e-3e4c-4766-8e91-0df9196e8f27 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:37.797263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-100b3a1e-3e4c-4766-8e91-0df9196e8f27 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:37.797263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-100b3a1e-3e4c-4766-8e91-0df9196e8f27 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:37.799345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-100b3a1e-3e4c-4766-8e91-0df9196e8f27 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:37.799949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-100b3a1e-3e4c-4766-8e91-0df9196e8f27 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:37.852153 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-888e3420-336d-4837-8795-64eb69f1e954 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.164198 Nov 08 17:39:37.853663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 84/175] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:39:36 2021] POST /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments => generated 194 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:38.496972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:38.500514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:38.509375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:38.510135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:38.511401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:38.512094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:38.663755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-100b3a1e-3e4c-4766-8e91-0df9196e8f27 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "POST /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880616 Nov 08 17:39:38.668926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 92/176] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:39:37 2021] POST /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8/os-volume_attachments => generated 194 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:39:38.724859 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:38.735711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:38.737255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:38.739352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-64b7f021-773a-445a-9987-d76854954ae2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1597 microversion: 2.20 time: 0.246582 Nov 08 17:39:38.739912 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 85/177] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:39:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1597 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:38.759754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b32f39f4-1e00-4463-b7fc-be93d07f9c56 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:38.760330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b32f39f4-1e00-4463-b7fc-be93d07f9c56 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:38.766322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b32f39f4-1e00-4463-b7fc-be93d07f9c56 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:38.766800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b32f39f4-1e00-4463-b7fc-be93d07f9c56 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:38.767569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b32f39f4-1e00-4463-b7fc-be93d07f9c56 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:38.768001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b32f39f4-1e00-4463-b7fc-be93d07f9c56 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:38.854486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1716688d-4914-42ea-9342-a24cd7bec534 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:38.856184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1716688d-4914-42ea-9342-a24cd7bec534 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:38.871911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1716688d-4914-42ea-9342-a24cd7bec534 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:38.876847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1716688d-4914-42ea-9342-a24cd7bec534 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:38.877854 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1716688d-4914-42ea-9342-a24cd7bec534 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:38.878481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1716688d-4914-42ea-9342-a24cd7bec534 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:38.904080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b32f39f4-1e00-4463-b7fc-be93d07f9c56 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.149747 Nov 08 17:39:38.905544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 93/178] 10.222.0.18 () {60 vars in 1315 bytes} [Mon Nov 8 17:39:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:39:38.916049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-dadf56b1-8832-4854-af88-9d9fd4e7a3d8 req-66fd9e3b-5e2d-4e8f-bbbe-370f375258c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabb9c79-5e8d-4982-a6eb-4169e2471b27", "tag": "6c56cad9-14a2-4272-bba1-d1d6fca923bd"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:38.917865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:38.917865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:38.934036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-dadf56b1-8832-4854-af88-9d9fd4e7a3d8 req-66fd9e3b-5e2d-4e8f-bbbe-370f375258c5 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:38.934487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-dadf56b1-8832-4854-af88-9d9fd4e7a3d8 req-66fd9e3b-5e2d-4e8f-bbbe-370f375258c5 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:38.952795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-dadf56b1-8832-4854-af88-9d9fd4e7a3d8 req-66fd9e3b-5e2d-4e8f-bbbe-370f375258c5 service nova] Creating event network-changed:6c56cad9-14a2-4272-bba1-d1d6fca923bd for instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 on hv-cinder-81689 Nov 08 17:39:38.976476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-dadf56b1-8832-4854-af88-9d9fd4e7a3d8 req-66fd9e3b-5e2d-4e8f-bbbe-370f375258c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062680 Nov 08 17:39:38.977178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 94/179] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:38.982587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1716688d-4914-42ea-9342-a24cd7bec534 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 0.133664 Nov 08 17:39:38.983340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 86/180] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:38 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:39:39.999797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-828f965d-75af-4993-bd8f-87d78b0c6291 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:40.001013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-828f965d-75af-4993-bd8f-87d78b0c6291 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:40.009939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-828f965d-75af-4993-bd8f-87d78b0c6291 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:40.014513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-828f965d-75af-4993-bd8f-87d78b0c6291 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:40.015366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-828f965d-75af-4993-bd8f-87d78b0c6291 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:40.018654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-828f965d-75af-4993-bd8f-87d78b0c6291 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:40.102599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-828f965d-75af-4993-bd8f-87d78b0c6291 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 0.106782 Nov 08 17:39:40.103324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 95/181] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:39 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:39:40.996627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-df09940f-adb3-485e-9088-94c61ec25937 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:40.998201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-df09940f-adb3-485e-9088-94c61ec25937 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:41.010766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df09940f-adb3-485e-9088-94c61ec25937 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:41.011210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df09940f-adb3-485e-9088-94c61ec25937 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:41.013689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df09940f-adb3-485e-9088-94c61ec25937 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:41.014126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df09940f-adb3-485e-9088-94c61ec25937 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:41.014367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-643f1a27-bc83-45db-8011-52f8c901cdeb req-d1de9a97-0801-4c22-86a7-57f0a8154423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf21b3ca-51f1-43c5-9b61-78422c205ff1", "tag": "fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:41.016593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:41.016593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:39:41.033691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-643f1a27-bc83-45db-8011-52f8c901cdeb req-d1de9a97-0801-4c22-86a7-57f0a8154423 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:41.038625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-643f1a27-bc83-45db-8011-52f8c901cdeb req-d1de9a97-0801-4c22-86a7-57f0a8154423 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:41.069275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-643f1a27-bc83-45db-8011-52f8c901cdeb req-d1de9a97-0801-4c22-86a7-57f0a8154423 service nova] Creating event network-changed:fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12 for instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 on hv-cinder-81689 Nov 08 17:39:41.074055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-643f1a27-bc83-45db-8011-52f8c901cdeb req-d1de9a97-0801-4c22-86a7-57f0a8154423 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064986 Nov 08 17:39:41.074876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 96/182] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:41.110041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-df09940f-adb3-485e-9088-94c61ec25937 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 0.120897 Nov 08 17:39:41.114536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9ef33044-4dda-4fff-babc-df470c1ea91a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:41.115627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 87/183] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:40 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:41.115744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9ef33044-4dda-4fff-babc-df470c1ea91a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:41.122604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9ef33044-4dda-4fff-babc-df470c1ea91a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:41.123050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9ef33044-4dda-4fff-babc-df470c1ea91a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:41.123826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9ef33044-4dda-4fff-babc-df470c1ea91a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:41.124250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9ef33044-4dda-4fff-babc-df470c1ea91a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:41.202654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9ef33044-4dda-4fff-babc-df470c1ea91a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 0.085263 Nov 08 17:39:41.203326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 97/184] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:41 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 17:39:42.123884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0e36d5b9-e3c9-4d0a-b9c2-e9a443ae7f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:42.124842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0e36d5b9-e3c9-4d0a-b9c2-e9a443ae7f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:42.131536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e36d5b9-e3c9-4d0a-b9c2-e9a443ae7f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:42.132641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e36d5b9-e3c9-4d0a-b9c2-e9a443ae7f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:42.133932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e36d5b9-e3c9-4d0a-b9c2-e9a443ae7f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:42.134655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e36d5b9-e3c9-4d0a-b9c2-e9a443ae7f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:42.309263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0e36d5b9-e3c9-4d0a-b9c2-e9a443ae7f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 0.087005 Nov 08 17:39:42.309263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 88/185] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:42 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:42.310488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7c02cdfc-2d43-44c4-bc20-2da02490a68e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:42.310488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7c02cdfc-2d43-44c4-bc20-2da02490a68e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:42.310488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7c02cdfc-2d43-44c4-bc20-2da02490a68e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:42.310488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7c02cdfc-2d43-44c4-bc20-2da02490a68e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:42.312509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7c02cdfc-2d43-44c4-bc20-2da02490a68e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:42.312509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7c02cdfc-2d43-44c4-bc20-2da02490a68e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:42.312509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7c02cdfc-2d43-44c4-bc20-2da02490a68e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 0.073587 Nov 08 17:39:42.312509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 98/186] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:42 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:39:43.315956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-25d6c46d-5331-450f-beec-9051c810a216 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:43.316504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-53b34813-ef23-41b3-bb90-64f4a38edde1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:43.317873 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-53b34813-ef23-41b3-bb90-64f4a38edde1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:43.318611 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-25d6c46d-5331-450f-beec-9051c810a216 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:43.324957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-53b34813-ef23-41b3-bb90-64f4a38edde1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:43.325394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-53b34813-ef23-41b3-bb90-64f4a38edde1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:43.325536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-25d6c46d-5331-450f-beec-9051c810a216 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:43.325875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-25d6c46d-5331-450f-beec-9051c810a216 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:43.326670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-25d6c46d-5331-450f-beec-9051c810a216 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:43.326790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-53b34813-ef23-41b3-bb90-64f4a38edde1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:43.327094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-25d6c46d-5331-450f-beec-9051c810a216 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:43.327332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-53b34813-ef23-41b3-bb90-64f4a38edde1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:46.027491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-25d6c46d-5331-450f-beec-9051c810a216 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 2.715407 Nov 08 17:39:46.028127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 89/187] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:43 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 2717 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 17:39:46.044050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-53b34813-ef23-41b3-bb90-64f4a38edde1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 2.731857 Nov 08 17:39:46.044684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 99/188] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:43 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 2733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:47.039700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-63d8e427-35b5-44a4-b5ae-d4d65f33ff3a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:47.040745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-63d8e427-35b5-44a4-b5ae-d4d65f33ff3a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:47.053982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-63d8e427-35b5-44a4-b5ae-d4d65f33ff3a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:47.054423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-63d8e427-35b5-44a4-b5ae-d4d65f33ff3a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:47.055228 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-63d8e427-35b5-44a4-b5ae-d4d65f33ff3a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:47.055995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fbc4b49d-e043-4b86-ae58-720650707e4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:47.056496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-63d8e427-35b5-44a4-b5ae-d4d65f33ff3a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:47.056982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fbc4b49d-e043-4b86-ae58-720650707e4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:47.064210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbc4b49d-e043-4b86-ae58-720650707e4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:47.064816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbc4b49d-e043-4b86-ae58-720650707e4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:47.065594 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbc4b49d-e043-4b86-ae58-720650707e4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:47.066022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbc4b49d-e043-4b86-ae58-720650707e4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:47.162828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-63d8e427-35b5-44a4-b5ae-d4d65f33ff3a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 0.127966 Nov 08 17:39:47.166161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 90/189] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:47 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:39:47.171090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fbc4b49d-e043-4b86-ae58-720650707e4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 0.119763 Nov 08 17:39:47.171732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 100/190] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:47 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:48.173563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9daff469-8206-4f38-8575-0bfd2eab036c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:48.178575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9daff469-8206-4f38-8575-0bfd2eab036c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:48.182190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9daff469-8206-4f38-8575-0bfd2eab036c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:48.182673 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9daff469-8206-4f38-8575-0bfd2eab036c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:48.185299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-eef9ce73-cb5a-4450-b0e9-5b24f5ee8ade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:48.187077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9daff469-8206-4f38-8575-0bfd2eab036c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:48.187185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-eef9ce73-cb5a-4450-b0e9-5b24f5ee8ade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:48.188130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9daff469-8206-4f38-8575-0bfd2eab036c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:48.196436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eef9ce73-cb5a-4450-b0e9-5b24f5ee8ade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:48.197223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eef9ce73-cb5a-4450-b0e9-5b24f5ee8ade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:48.198983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eef9ce73-cb5a-4450-b0e9-5b24f5ee8ade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:48.200309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eef9ce73-cb5a-4450-b0e9-5b24f5ee8ade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:48.280679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9daff469-8206-4f38-8575-0bfd2eab036c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 0.111000 Nov 08 17:39:48.282627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 91/191] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:48 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:39:48.310422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-eef9ce73-cb5a-4450-b0e9-5b24f5ee8ade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 0.129927 Nov 08 17:39:48.313595 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 101/192] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:48 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:48.555581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-595454217", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "networks": [{"uuid": "7538bf23-b616-4166-98b8-7a0c2b2bdf89"}]}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:48.613888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] validate_networks() for [('7538bf23-b616-4166-98b8-7a0c2b2bdf89', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:39:49.018225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:39:49.018757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:39:49.019310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:39:49.020848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:39:49.021336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:39:49.034206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:49.034907 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:49.036526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:49.037031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:49.061271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Getting quotas for project ef1c05515852427e84b12522c50545fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:39:49.065588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Getting quotas for user 6ca86df4b2b6476fae354e9e96fbdf53 and project ef1c05515852427e84b12522c50545fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:39:49.085585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:39:49.085585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:39:49.251606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-43d2d901-29da-4659-8cf0-99d2dfe198f8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700535 Nov 08 17:39:49.258712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 92/193] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:39:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:39:49.266433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-26b3ff73-a4f2-469f-8fe3-65efedc4a2f0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:49.267226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-26b3ff73-a4f2-469f-8fe3-65efedc4a2f0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:49.299638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b3c59470-d33a-4446-8372-7a2a7e580188 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:49.299638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b3c59470-d33a-4446-8372-7a2a7e580188 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:49.308730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3c59470-d33a-4446-8372-7a2a7e580188 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:49.309385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3c59470-d33a-4446-8372-7a2a7e580188 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:49.310168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3c59470-d33a-4446-8372-7a2a7e580188 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:49.312147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3c59470-d33a-4446-8372-7a2a7e580188 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:49.378347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26b3ff73-a4f2-469f-8fe3-65efedc4a2f0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:49.389910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-26b3ff73-a4f2-469f-8fe3-65efedc4a2f0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1217 microversion: 2.1 time: 0.128978 Nov 08 17:39:49.401564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 102/194] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:49 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:49.401564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e530d50d-8002-4407-b87b-c71b4a84f585 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:49.401564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e530d50d-8002-4407-b87b-c71b4a84f585 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:49.407407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e530d50d-8002-4407-b87b-c71b4a84f585 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:49.407995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e530d50d-8002-4407-b87b-c71b4a84f585 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:49.408864 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e530d50d-8002-4407-b87b-c71b4a84f585 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:49.409533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e530d50d-8002-4407-b87b-c71b4a84f585 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:49.469774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b3c59470-d33a-4446-8372-7a2a7e580188 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 0.178277 Nov 08 17:39:49.470610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 93/195] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:49 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:39:49.495477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e530d50d-8002-4407-b87b-c71b4a84f585 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 0.102351 Nov 08 17:39:49.499065 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 103/196] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:49 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:50.409339 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-09a97d72-9144-47cc-b13c-96e22f55d436 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:50.410125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-09a97d72-9144-47cc-b13c-96e22f55d436 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:50.419766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09a97d72-9144-47cc-b13c-96e22f55d436 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:50.420211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09a97d72-9144-47cc-b13c-96e22f55d436 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:50.420986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09a97d72-9144-47cc-b13c-96e22f55d436 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:50.421781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09a97d72-9144-47cc-b13c-96e22f55d436 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:50.483181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9a7b4833-455c-47e2-b5eb-975d33cbce7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:50.485181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9a7b4833-455c-47e2-b5eb-975d33cbce7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:50.502514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a7b4833-455c-47e2-b5eb-975d33cbce7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:50.505098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a7b4833-455c-47e2-b5eb-975d33cbce7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:50.506699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a7b4833-455c-47e2-b5eb-975d33cbce7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:50.507597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a7b4833-455c-47e2-b5eb-975d33cbce7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:50.538058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-09a97d72-9144-47cc-b13c-96e22f55d436 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:50.545869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-09a97d72-9144-47cc-b13c-96e22f55d436 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1221 microversion: 2.1 time: 0.140863 Nov 08 17:39:50.546451 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 94/197] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:50 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:50.567787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-129f3435-973e-4e9d-9a9a-3d15b3b1467d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:50.567787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-129f3435-973e-4e9d-9a9a-3d15b3b1467d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:50.569703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-129f3435-973e-4e9d-9a9a-3d15b3b1467d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:50.570150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-129f3435-973e-4e9d-9a9a-3d15b3b1467d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:50.571216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-129f3435-973e-4e9d-9a9a-3d15b3b1467d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:50.571489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-129f3435-973e-4e9d-9a9a-3d15b3b1467d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:50.591548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9a7b4833-455c-47e2-b5eb-975d33cbce7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 14 microversion: 2.1 time: 0.113602 Nov 08 17:39:50.592213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 104/198] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:50 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:39:50.660291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-129f3435-973e-4e9d-9a9a-3d15b3b1467d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 0.102434 Nov 08 17:39:50.662580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 95/199] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:50 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:51.564397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-db04aaf1-5f8e-4e2a-99cd-0c558e2dc42b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:51.578236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-db04aaf1-5f8e-4e2a-99cd-0c558e2dc42b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:51.578236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-db04aaf1-5f8e-4e2a-99cd-0c558e2dc42b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:51.578236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-db04aaf1-5f8e-4e2a-99cd-0c558e2dc42b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:51.578236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-db04aaf1-5f8e-4e2a-99cd-0c558e2dc42b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:51.578660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-db04aaf1-5f8e-4e2a-99cd-0c558e2dc42b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:51.607328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-18a25d34-7cac-4e09-bd57-ea26bf584233 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:51.608684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-18a25d34-7cac-4e09-bd57-ea26bf584233 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:51.618974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18a25d34-7cac-4e09-bd57-ea26bf584233 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:51.619619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18a25d34-7cac-4e09-bd57-ea26bf584233 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:51.620629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18a25d34-7cac-4e09-bd57-ea26bf584233 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:51.621167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18a25d34-7cac-4e09-bd57-ea26bf584233 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:51.659337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-db04aaf1-5f8e-4e2a-99cd-0c558e2dc42b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:51.668053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-db04aaf1-5f8e-4e2a-99cd-0c558e2dc42b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1269 microversion: 2.1 time: 0.108137 Nov 08 17:39:51.669577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 105/200] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:51 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1269 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:51.674479 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cd9d9173-3b8f-4388-8901-4700fd81d2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:51.675391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cd9d9173-3b8f-4388-8901-4700fd81d2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:51.682748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd9d9173-3b8f-4388-8901-4700fd81d2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:51.683242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd9d9173-3b8f-4388-8901-4700fd81d2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:51.684202 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd9d9173-3b8f-4388-8901-4700fd81d2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:51.684783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd9d9173-3b8f-4388-8901-4700fd81d2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:51.750856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-18a25d34-7cac-4e09-bd57-ea26bf584233 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 7202 microversion: 2.1 time: 0.149807 Nov 08 17:39:51.751672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 96/201] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:51 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 7202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:51.774602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cd9d9173-3b8f-4388-8901-4700fd81d2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 0.103461 Nov 08 17:39:51.775247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 106/202] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:51 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:52.687041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e141a6ba-ee73-4269-a09b-e41872aebc37 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:52.688237 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e141a6ba-ee73-4269-a09b-e41872aebc37 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:52.695201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e141a6ba-ee73-4269-a09b-e41872aebc37 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:52.695730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e141a6ba-ee73-4269-a09b-e41872aebc37 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:52.696510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e141a6ba-ee73-4269-a09b-e41872aebc37 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:52.696940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e141a6ba-ee73-4269-a09b-e41872aebc37 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:52.763955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-160cfc20-de1a-4812-a65b-c63b2f948969 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:52.765965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-160cfc20-de1a-4812-a65b-c63b2f948969 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:52.780546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-160cfc20-de1a-4812-a65b-c63b2f948969 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:52.782314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-160cfc20-de1a-4812-a65b-c63b2f948969 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:52.786729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-160cfc20-de1a-4812-a65b-c63b2f948969 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:52.789485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-160cfc20-de1a-4812-a65b-c63b2f948969 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:52.924704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-160cfc20-de1a-4812-a65b-c63b2f948969 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 13218 microversion: 2.1 time: 0.166262 Nov 08 17:39:52.925344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 107/203] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:52 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 13218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:39:52.933590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7ededbb2-d176-4654-8ea6-3efe4ad7880e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:52.939659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7ededbb2-d176-4654-8ea6-3efe4ad7880e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:52.967708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ededbb2-d176-4654-8ea6-3efe4ad7880e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:52.976027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ededbb2-d176-4654-8ea6-3efe4ad7880e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:52.976027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ededbb2-d176-4654-8ea6-3efe4ad7880e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:52.976027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ededbb2-d176-4654-8ea6-3efe4ad7880e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:53.024985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e141a6ba-ee73-4269-a09b-e41872aebc37 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:53.037644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e141a6ba-ee73-4269-a09b-e41872aebc37 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1317 microversion: 2.1 time: 0.352503 Nov 08 17:39:53.038240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 97/204] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:52 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:53.095211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7ededbb2-d176-4654-8ea6-3efe4ad7880e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 14 microversion: 2.20 time: 0.167761 Nov 08 17:39:53.095835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 108/205] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:52 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:53.916383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-3d0e2432-585a-489d-b565-3fe4c6d766b0 req-48ca0557-abda-448c-9ce5-27f2523182ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a509ca1b-3060-40c0-a623-4bad45e34fe0", "tag": "ae841737-f79a-469b-939f-93ef0f922140"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:53.918682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:53.918682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:39:53.940542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ae3930cd-1ef6-42e2-b24a-a33cf8ee17df tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:53.943518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ae3930cd-1ef6-42e2-b24a-a33cf8ee17df tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:53.948593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-3d0e2432-585a-489d-b565-3fe4c6d766b0 req-48ca0557-abda-448c-9ce5-27f2523182ef service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:53.949077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-3d0e2432-585a-489d-b565-3fe4c6d766b0 req-48ca0557-abda-448c-9ce5-27f2523182ef service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:53.953023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ae3930cd-1ef6-42e2-b24a-a33cf8ee17df tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:53.954377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ae3930cd-1ef6-42e2-b24a-a33cf8ee17df tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:53.957919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ae3930cd-1ef6-42e2-b24a-a33cf8ee17df tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:53.957919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ae3930cd-1ef6-42e2-b24a-a33cf8ee17df tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:53.978286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-3d0e2432-585a-489d-b565-3fe4c6d766b0 req-48ca0557-abda-448c-9ce5-27f2523182ef service nova] Creating event network-changed:ae841737-f79a-469b-939f-93ef0f922140 for instance a509ca1b-3060-40c0-a623-4bad45e34fe0 on hv-cinder-81689 Nov 08 17:39:53.985911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-3d0e2432-585a-489d-b565-3fe4c6d766b0 req-48ca0557-abda-448c-9ce5-27f2523182ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075551 Nov 08 17:39:53.991231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 98/206] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:54.055991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-833d18de-c369-4001-bda7-7a16c99be6d3 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:54.056680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-833d18de-c369-4001-bda7-7a16c99be6d3 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:54.061102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ae3930cd-1ef6-42e2-b24a-a33cf8ee17df tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 17861 microversion: 2.1 time: 0.125143 Nov 08 17:39:54.061968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 109/207] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:53 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 17861 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:39:54.068139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-833d18de-c369-4001-bda7-7a16c99be6d3 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:54.068730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-833d18de-c369-4001-bda7-7a16c99be6d3 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:54.069589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-833d18de-c369-4001-bda7-7a16c99be6d3 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:54.070030 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-833d18de-c369-4001-bda7-7a16c99be6d3 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:54.107250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8df84cab-ea25-4735-8843-627714093fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:54.108245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8df84cab-ea25-4735-8843-627714093fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:54.132658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df84cab-ea25-4735-8843-627714093fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:54.133128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df84cab-ea25-4735-8843-627714093fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:54.133899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df84cab-ea25-4735-8843-627714093fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:54.134327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df84cab-ea25-4735-8843-627714093fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:54.241942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8df84cab-ea25-4735-8843-627714093fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 6257 microversion: 2.20 time: 0.138510 Nov 08 17:39:54.243179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 110/208] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:54 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 6257 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:39:54.296183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-833d18de-c369-4001-bda7-7a16c99be6d3 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:54.296183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-833d18de-c369-4001-bda7-7a16c99be6d3 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1317 microversion: 2.1 time: 0.234541 Nov 08 17:39:54.296183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 99/209] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:54 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:55.074304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6ae134c7-cfcc-41f6-a6b6-11d7d8d079d6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:55.075644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6ae134c7-cfcc-41f6-a6b6-11d7d8d079d6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:55.083509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ae134c7-cfcc-41f6-a6b6-11d7d8d079d6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:55.084121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ae134c7-cfcc-41f6-a6b6-11d7d8d079d6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:55.085021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ae134c7-cfcc-41f6-a6b6-11d7d8d079d6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:55.085694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ae134c7-cfcc-41f6-a6b6-11d7d8d079d6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:55.189589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6ae134c7-cfcc-41f6-a6b6-11d7d8d079d6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 17861 microversion: 2.1 time: 0.119076 Nov 08 17:39:55.190562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 111/210] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:55 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 17861 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:39:55.253337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9d067eed-ac1b-4026-80a1-521a5a35d9cc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:55.254855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9d067eed-ac1b-4026-80a1-521a5a35d9cc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:55.261288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d067eed-ac1b-4026-80a1-521a5a35d9cc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:55.261736 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d067eed-ac1b-4026-80a1-521a5a35d9cc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:55.263487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d067eed-ac1b-4026-80a1-521a5a35d9cc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:55.263487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d067eed-ac1b-4026-80a1-521a5a35d9cc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:55.309622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8a6bc245-038a-423f-b37f-62a1d1d02879 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:55.310412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8a6bc245-038a-423f-b37f-62a1d1d02879 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:55.333413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a6bc245-038a-423f-b37f-62a1d1d02879 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:55.333852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a6bc245-038a-423f-b37f-62a1d1d02879 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:55.334677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a6bc245-038a-423f-b37f-62a1d1d02879 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:55.335105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a6bc245-038a-423f-b37f-62a1d1d02879 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:55.367341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9d067eed-ac1b-4026-80a1-521a5a35d9cc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 10044 microversion: 2.20 time: 0.117579 Nov 08 17:39:55.368443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 100/211] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:55 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 10044 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:39:55.515588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8a6bc245-038a-423f-b37f-62a1d1d02879 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:55.523845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8a6bc245-038a-423f-b37f-62a1d1d02879 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1317 microversion: 2.1 time: 0.219393 Nov 08 17:39:55.524415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 112/212] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:55 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:55.962035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c36c00b5-face-4147-be6e-f2fe21fdc688 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:55.962712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c36c00b5-face-4147-be6e-f2fe21fdc688 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:55.971233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c36c00b5-face-4147-be6e-f2fe21fdc688 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:55.972232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c36c00b5-face-4147-be6e-f2fe21fdc688 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:55.975369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c36c00b5-face-4147-be6e-f2fe21fdc688 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:55.975888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c36c00b5-face-4147-be6e-f2fe21fdc688 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.018151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c36c00b5-face-4147-be6e-f2fe21fdc688 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Going to try to terminate instance {{(pid=127763) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:39:56.203318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b6fd181d-acb9-41de-b9cb-4bbe1b65ad96 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:56.204829 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b6fd181d-acb9-41de-b9cb-4bbe1b65ad96 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:56.212377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6fd181d-acb9-41de-b9cb-4bbe1b65ad96 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:56.212738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6fd181d-acb9-41de-b9cb-4bbe1b65ad96 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.213559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6fd181d-acb9-41de-b9cb-4bbe1b65ad96 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:56.213989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6fd181d-acb9-41de-b9cb-4bbe1b65ad96 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.308309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b6fd181d-acb9-41de-b9cb-4bbe1b65ad96 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 19342 microversion: 2.1 time: 0.110166 Nov 08 17:39:56.308403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 113/213] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:56 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 19342 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:39:56.364905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c36c00b5-face-4147-be6e-f2fe21fdc688 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 204 len: 0 microversion: 2.1 time: 0.406346 Nov 08 17:39:56.365560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 101/214] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:39:55 2021] DELETE /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:39:56.376291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fd78cd89-456d-4ad2-a51d-c301fe2dc547 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:56.377281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fd78cd89-456d-4ad2-a51d-c301fe2dc547 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:56.379035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-15875ed2-0b30-4f96-a347-6bb6e9432da8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:56.380305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-15875ed2-0b30-4f96-a347-6bb6e9432da8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:56.385175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd78cd89-456d-4ad2-a51d-c301fe2dc547 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:56.385730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd78cd89-456d-4ad2-a51d-c301fe2dc547 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.386140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15875ed2-0b30-4f96-a347-6bb6e9432da8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:56.386632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15875ed2-0b30-4f96-a347-6bb6e9432da8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.386885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd78cd89-456d-4ad2-a51d-c301fe2dc547 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:56.387402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15875ed2-0b30-4f96-a347-6bb6e9432da8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:56.387509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd78cd89-456d-4ad2-a51d-c301fe2dc547 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.387851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15875ed2-0b30-4f96-a347-6bb6e9432da8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.484584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-15875ed2-0b30-4f96-a347-6bb6e9432da8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 15025 microversion: 2.20 time: 0.109509 Nov 08 17:39:56.489395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 102/215] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:56 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 15025 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:39:56.544167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-df0fc304-0a62-4585-899d-3a11a632dcd0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:56.545703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-df0fc304-0a62-4585-899d-3a11a632dcd0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:56.549774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fd78cd89-456d-4ad2-a51d-c301fe2dc547 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:56.556124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df0fc304-0a62-4585-899d-3a11a632dcd0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:56.556902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df0fc304-0a62-4585-899d-3a11a632dcd0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.557901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df0fc304-0a62-4585-899d-3a11a632dcd0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:56.558104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fd78cd89-456d-4ad2-a51d-c301fe2dc547 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1554 microversion: 2.1 time: 0.187600 Nov 08 17:39:56.558938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df0fc304-0a62-4585-899d-3a11a632dcd0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:56.559047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 114/216] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:56 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:56.699740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df0fc304-0a62-4585-899d-3a11a632dcd0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:56.712341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-df0fc304-0a62-4585-899d-3a11a632dcd0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1317 microversion: 2.1 time: 0.170171 Nov 08 17:39:56.712341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 103/217] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:56 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:57.323347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0fab8bed-42a3-471f-8ebe-846ba4f991bb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:57.324410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0fab8bed-42a3-471f-8ebe-846ba4f991bb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:57.330886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0fab8bed-42a3-471f-8ebe-846ba4f991bb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:57.331511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0fab8bed-42a3-471f-8ebe-846ba4f991bb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:57.333937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0fab8bed-42a3-471f-8ebe-846ba4f991bb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:57.335293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0fab8bed-42a3-471f-8ebe-846ba4f991bb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:57.427553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0fab8bed-42a3-471f-8ebe-846ba4f991bb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 20985 microversion: 2.1 time: 0.108064 Nov 08 17:39:57.428681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 115/218] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:57 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 20985 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:39:57.498930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-49c6bf68-6d42-44e8-9fcf-bfcad61808e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:57.499845 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-49c6bf68-6d42-44e8-9fcf-bfcad61808e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:57.507413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49c6bf68-6d42-44e8-9fcf-bfcad61808e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:57.507861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49c6bf68-6d42-44e8-9fcf-bfcad61808e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:57.508641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49c6bf68-6d42-44e8-9fcf-bfcad61808e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:57.509228 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49c6bf68-6d42-44e8-9fcf-bfcad61808e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:57.575726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-27b5d7be-377e-48fb-abce-23b2e615d63d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:57.576336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-27b5d7be-377e-48fb-abce-23b2e615d63d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:57.583777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27b5d7be-377e-48fb-abce-23b2e615d63d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:57.584240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27b5d7be-377e-48fb-abce-23b2e615d63d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:57.585056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27b5d7be-377e-48fb-abce-23b2e615d63d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:57.585492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27b5d7be-377e-48fb-abce-23b2e615d63d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:57.615757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-49c6bf68-6d42-44e8-9fcf-bfcad61808e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 17055 microversion: 2.20 time: 0.120381 Nov 08 17:39:57.616642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 104/219] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:57 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 17055 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:39:57.726335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0404c2d9-bfd4-49ad-9aec-4a8b79c92806 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:57.727059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0404c2d9-bfd4-49ad-9aec-4a8b79c92806 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:57.733925 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0404c2d9-bfd4-49ad-9aec-4a8b79c92806 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:57.734373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0404c2d9-bfd4-49ad-9aec-4a8b79c92806 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:57.735234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0404c2d9-bfd4-49ad-9aec-4a8b79c92806 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:57.735704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0404c2d9-bfd4-49ad-9aec-4a8b79c92806 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:57.817691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-27b5d7be-377e-48fb-abce-23b2e615d63d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:57.825583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-27b5d7be-377e-48fb-abce-23b2e615d63d tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1554 microversion: 2.1 time: 0.254149 Nov 08 17:39:57.826218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 116/220] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:57 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:57.888235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0404c2d9-bfd4-49ad-9aec-4a8b79c92806 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:57.895918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0404c2d9-bfd4-49ad-9aec-4a8b79c92806 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1317 microversion: 2.1 time: 0.174124 Nov 08 17:39:57.896488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 105/221] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:57 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:58.450868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-68633a52-716a-4fb5-857d-04578ff5adb2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:58.454500 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-68633a52-716a-4fb5-857d-04578ff5adb2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:58.468337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68633a52-716a-4fb5-857d-04578ff5adb2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:58.469645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68633a52-716a-4fb5-857d-04578ff5adb2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:58.470613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68633a52-716a-4fb5-857d-04578ff5adb2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:58.471265 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68633a52-716a-4fb5-857d-04578ff5adb2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:58.587922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-68633a52-716a-4fb5-857d-04578ff5adb2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 22156 microversion: 2.1 time: 0.148008 Nov 08 17:39:58.589673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 117/222] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:58 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 22156 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:39:58.627198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f948869c-834b-4f52-902d-7d76a5b74968 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:58.628103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f948869c-834b-4f52-902d-7d76a5b74968 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:58.634698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f948869c-834b-4f52-902d-7d76a5b74968 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:58.635421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f948869c-834b-4f52-902d-7d76a5b74968 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:58.636241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f948869c-834b-4f52-902d-7d76a5b74968 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:58.636665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f948869c-834b-4f52-902d-7d76a5b74968 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:58.743022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f948869c-834b-4f52-902d-7d76a5b74968 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 17808 microversion: 2.20 time: 0.118812 Nov 08 17:39:58.748276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 106/223] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:58 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 17808 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:39:58.845102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-56d3523a-487f-418f-9a4a-0837f4daef2b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:58.847581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-56d3523a-487f-418f-9a4a-0837f4daef2b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:58.865155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56d3523a-487f-418f-9a4a-0837f4daef2b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:58.865605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56d3523a-487f-418f-9a4a-0837f4daef2b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:58.869487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56d3523a-487f-418f-9a4a-0837f4daef2b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:58.869940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56d3523a-487f-418f-9a4a-0837f4daef2b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:58.914020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c6bf8a85-bf05-4bc9-b156-0c1ffa589ed5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:39:58.915750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c6bf8a85-bf05-4bc9-b156-0c1ffa589ed5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:58.926486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c6bf8a85-bf05-4bc9-b156-0c1ffa589ed5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:58.927311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c6bf8a85-bf05-4bc9-b156-0c1ffa589ed5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:58.929273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c6bf8a85-bf05-4bc9-b156-0c1ffa589ed5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:58.929958 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c6bf8a85-bf05-4bc9-b156-0c1ffa589ed5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:59.220089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c6bf8a85-bf05-4bc9-b156-0c1ffa589ed5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:59.223644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-56d3523a-487f-418f-9a4a-0837f4daef2b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:39:59.230980 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c6bf8a85-bf05-4bc9-b156-0c1ffa589ed5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1317 microversion: 2.1 time: 0.321509 Nov 08 17:39:59.231831 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 107/224] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:58 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:39:59.250439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-56d3523a-487f-418f-9a4a-0837f4daef2b tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1554 microversion: 2.1 time: 0.410777 Nov 08 17:39:59.278129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 118/225] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:39:58 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1554 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:39:59.569134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-b94b7996-7ce2-4148-8577-481db5420f61 req-aa906c11-5f8f-479b-8ba7-2d5af535dcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fce4e35-eea4-4afa-8842-ca97bcde50b8", "name": "network-vif-deleted", "tag": "68acbcbe-f5ac-4ddb-b8d8-a5f13cd9ff20"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:59.570681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:39:59.570681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:39:59.579133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-b94b7996-7ce2-4148-8577-481db5420f61 req-aa906c11-5f8f-479b-8ba7-2d5af535dcbe service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:59.587576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-b94b7996-7ce2-4148-8577-481db5420f61 req-aa906c11-5f8f-479b-8ba7-2d5af535dcbe service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:59.590022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-b94b7996-7ce2-4148-8577-481db5420f61 req-aa906c11-5f8f-479b-8ba7-2d5af535dcbe service nova] Creating event network-vif-deleted:68acbcbe-f5ac-4ddb-b8d8-a5f13cd9ff20 for instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 on hv-cinder-81689 Nov 08 17:39:59.594821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-b94b7996-7ce2-4148-8577-481db5420f61 req-aa906c11-5f8f-479b-8ba7-2d5af535dcbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029605 Nov 08 17:39:59.595393 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 108/226] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:39:59.600520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1a638a1c-55fe-4abd-9a82-767789d6219e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:59.601445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1a638a1c-55fe-4abd-9a82-767789d6219e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:59.608104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a638a1c-55fe-4abd-9a82-767789d6219e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:59.610725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a638a1c-55fe-4abd-9a82-767789d6219e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:59.610725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a638a1c-55fe-4abd-9a82-767789d6219e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:59.610725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a638a1c-55fe-4abd-9a82-767789d6219e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:59.710297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1a638a1c-55fe-4abd-9a82-767789d6219e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 23166 microversion: 2.1 time: 0.113783 Nov 08 17:39:59.711115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 119/227] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:39:59 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 23166 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:39:59.756820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e0602c1e-9d30-493d-97e2-c7e2f68c9593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:39:59.757850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e0602c1e-9d30-493d-97e2-c7e2f68c9593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:39:59.764377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0602c1e-9d30-493d-97e2-c7e2f68c9593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:59.764822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0602c1e-9d30-493d-97e2-c7e2f68c9593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:59.765640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0602c1e-9d30-493d-97e2-c7e2f68c9593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:39:59.766040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0602c1e-9d30-493d-97e2-c7e2f68c9593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:39:59.862021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e0602c1e-9d30-493d-97e2-c7e2f68c9593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 19243 microversion: 2.20 time: 0.109613 Nov 08 17:39:59.862690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 109/228] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:39:59 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 19243 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:00.249151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-818a681e-690c-40b8-85c8-cf7e7ee9d7b8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:00.250016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-818a681e-690c-40b8-85c8-cf7e7ee9d7b8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:00.260645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-818a681e-690c-40b8-85c8-cf7e7ee9d7b8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.261109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-818a681e-690c-40b8-85c8-cf7e7ee9d7b8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:00.261910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-818a681e-690c-40b8-85c8-cf7e7ee9d7b8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.263000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-818a681e-690c-40b8-85c8-cf7e7ee9d7b8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:00.284460 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3edcba5c-45fe-425f-ab50-535b90780471 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:00.285409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3edcba5c-45fe-425f-ab50-535b90780471 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:00.302349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3edcba5c-45fe-425f-ab50-535b90780471 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.302349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3edcba5c-45fe-425f-ab50-535b90780471 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:00.302349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3edcba5c-45fe-425f-ab50-535b90780471 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.302788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3edcba5c-45fe-425f-ab50-535b90780471 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:00.379926 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3edcba5c-45fe-425f-ab50-535b90780471 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:00.389317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3edcba5c-45fe-425f-ab50-535b90780471 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1346 microversion: 2.1 time: 0.109382 Nov 08 17:40:00.389900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 110/229] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:00 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:00.403761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-4a4e9e19-2a19-4e21-a2ca-d2a14d62cd71 req-e36f8fea-92ae-427b-bcf4-444a3f3f3d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a509ca1b-3060-40c0-a623-4bad45e34fe0", "name": "network-vif-plugged", "status": "completed", "tag": "ae841737-f79a-469b-939f-93ef0f922140"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:00.405470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:00.405470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:40:00.413259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-4a4e9e19-2a19-4e21-a2ca-d2a14d62cd71 req-e36f8fea-92ae-427b-bcf4-444a3f3f3d36 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.417596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-4a4e9e19-2a19-4e21-a2ca-d2a14d62cd71 req-e36f8fea-92ae-427b-bcf4-444a3f3f3d36 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:00.431454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-4a4e9e19-2a19-4e21-a2ca-d2a14d62cd71 req-e36f8fea-92ae-427b-bcf4-444a3f3f3d36 service nova] Creating event network-vif-plugged:ae841737-f79a-469b-939f-93ef0f922140 for instance a509ca1b-3060-40c0-a623-4bad45e34fe0 on hv-cinder-81689 Nov 08 17:40:00.439343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-4a4e9e19-2a19-4e21-a2ca-d2a14d62cd71 req-e36f8fea-92ae-427b-bcf4-444a3f3f3d36 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038839 Nov 08 17:40:00.440027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 111/230] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:00.480295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-818a681e-690c-40b8-85c8-cf7e7ee9d7b8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:00.502441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-818a681e-690c-40b8-85c8-cf7e7ee9d7b8 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1317 microversion: 2.1 time: 0.257800 Nov 08 17:40:00.503047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 120/231] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:00 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:00.562367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1445829073", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "networks": [{"uuid": "d915a2e0-6f4f-40e6-bfd6-8506152b8092"}]}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:00.627615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] validate_networks() for [('d915a2e0-6f4f-40e6-bfd6-8506152b8092', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:40:00.721638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-167ab34d-5f60-44e9-b85e-5bce5dd72000 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:00.722617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-167ab34d-5f60-44e9-b85e-5bce5dd72000 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:00.729391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-167ab34d-5f60-44e9-b85e-5bce5dd72000 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.729837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-167ab34d-5f60-44e9-b85e-5bce5dd72000 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:00.730724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-167ab34d-5f60-44e9-b85e-5bce5dd72000 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.731305 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-167ab34d-5f60-44e9-b85e-5bce5dd72000 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:00.820583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-167ab34d-5f60-44e9-b85e-5bce5dd72000 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 24017 microversion: 2.1 time: 0.102116 Nov 08 17:40:00.822527 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 121/232] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:00 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 24017 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:40:00.882195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-decee1d0-890a-4a9f-a433-e82db2f8014a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:00.883302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-decee1d0-890a-4a9f-a433-e82db2f8014a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:00.891169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-decee1d0-890a-4a9f-a433-e82db2f8014a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.892293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-decee1d0-890a-4a9f-a433-e82db2f8014a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:00.893510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-decee1d0-890a-4a9f-a433-e82db2f8014a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:00.895604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-decee1d0-890a-4a9f-a433-e82db2f8014a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.005349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:40:01.005768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:40:01.006046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:40:01.006442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:40:01.006867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:40:01.015480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.015916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.016702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.017126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.032760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Getting quotas for project 617b49281015470ba0eb03102015c072. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:40:01.036598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Getting quotas for user 2cc50d8aef6145358cf9563338a5321c and project 617b49281015470ba0eb03102015c072. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:40:01.046936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:40:01.049274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:40:01.128455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-decee1d0-890a-4a9f-a433-e82db2f8014a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 21935 microversion: 2.20 time: 0.251798 Nov 08 17:40:01.129678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 122/233] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:00 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 21935 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:01.164101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-02dcd403-39d4-4198-965e-2a232ad00b8f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606601 Nov 08 17:40:01.164745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 112/234] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:40:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:40:01.175142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-02cf7110-f986-4c31-8273-d732f2b8a0f8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:01.176457 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-02cf7110-f986-4c31-8273-d732f2b8a0f8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:01.237288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-02cf7110-f986-4c31-8273-d732f2b8a0f8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:01.244361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-02cf7110-f986-4c31-8273-d732f2b8a0f8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1214 microversion: 2.1 time: 0.073470 Nov 08 17:40:01.244924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 123/235] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:01 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:01.406367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:01.407023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:01.414523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.414971 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.415747 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.416179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.446175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.446657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.447121 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lazy-loading 'fault' on Instance uuid 7fce4e35-eea4-4afa-8842-ca97bcde50b8 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:40:01.493620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14608710751146fbb4a56bb75b2bf8ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aeacdcc2522496daf04e277f4de53c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:01.501197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9212775e-d87a-4f53-96f6-a5bc92e86cd0 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 200 len: 1305 microversion: 2.1 time: 0.098476 Nov 08 17:40:01.503102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 113/236] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:01 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:01.519339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ecafec85-e508-4588-8294-4f968ecfedb7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:01.520245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ecafec85-e508-4588-8294-4f968ecfedb7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:01.527321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecafec85-e508-4588-8294-4f968ecfedb7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.532316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecafec85-e508-4588-8294-4f968ecfedb7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.532316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecafec85-e508-4588-8294-4f968ecfedb7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.532316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecafec85-e508-4588-8294-4f968ecfedb7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.672928 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ecafec85-e508-4588-8294-4f968ecfedb7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:01.680998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ecafec85-e508-4588-8294-4f968ecfedb7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1317 microversion: 2.1 time: 0.165567 Nov 08 17:40:01.681574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 124/237] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:01 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:01.833317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-13a2fb73-1e01-49f2-9ca4-eb50e8c42593 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:01.834276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-13a2fb73-1e01-49f2-9ca4-eb50e8c42593 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:01.840119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13a2fb73-1e01-49f2-9ca4-eb50e8c42593 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.840555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13a2fb73-1e01-49f2-9ca4-eb50e8c42593 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.841323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13a2fb73-1e01-49f2-9ca4-eb50e8c42593 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:01.841743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13a2fb73-1e01-49f2-9ca4-eb50e8c42593 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:01.934170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-13a2fb73-1e01-49f2-9ca4-eb50e8c42593 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 25138 microversion: 2.1 time: 0.104759 Nov 08 17:40:01.938270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 114/238] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:01 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 25138 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:40:02.147764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-eb17976d-a123-4bd6-83f5-ca95f391900a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:02.148775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-eb17976d-a123-4bd6-83f5-ca95f391900a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:02.155040 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eb17976d-a123-4bd6-83f5-ca95f391900a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.155486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eb17976d-a123-4bd6-83f5-ca95f391900a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.156263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eb17976d-a123-4bd6-83f5-ca95f391900a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.156691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eb17976d-a123-4bd6-83f5-ca95f391900a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.249332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-eb17976d-a123-4bd6-83f5-ca95f391900a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 22983 microversion: 2.20 time: 0.105235 Nov 08 17:40:02.250590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 125/239] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:02 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 22983 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:02.264700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-eaa28015-52b5-4f14-b1cf-6d9daceed901 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:02.264700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-eaa28015-52b5-4f14-b1cf-6d9daceed901 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:02.269125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eaa28015-52b5-4f14-b1cf-6d9daceed901 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.269608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eaa28015-52b5-4f14-b1cf-6d9daceed901 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.270602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eaa28015-52b5-4f14-b1cf-6d9daceed901 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.271029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eaa28015-52b5-4f14-b1cf-6d9daceed901 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.346060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-eaa28015-52b5-4f14-b1cf-6d9daceed901 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:02.354822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-eaa28015-52b5-4f14-b1cf-6d9daceed901 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1218 microversion: 2.1 time: 0.097210 Nov 08 17:40:02.355392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 115/240] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:02 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:02.520290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:02.521017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:02.528363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.528809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.529591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.530017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.553703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] HTTP exception thrown: Instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 could not be found. Nov 08 17:40:02.554662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Returning 404 to user: Instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:02.556088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-578e3f52-6415-4de0-8e24-d2d105391ccf tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 404 len: 111 microversion: 2.1 time: 0.040073 Nov 08 17:40:02.561576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 126/241] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:02 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:40:02.668718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:02.669703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:02.676533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.677049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.677913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.678417 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.692230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] HTTP exception thrown: Instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 could not be found. Nov 08 17:40:02.692905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Returning 404 to user: Instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:02.693793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fe79c27f-c722-4deb-b439-580053b439da tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029059 Nov 08 17:40:02.694414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 116/242] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:02 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:40:02.697813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-17eca6c4-2b9a-452e-ac55-d43cbf1272c2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:02.698419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-17eca6c4-2b9a-452e-ac55-d43cbf1272c2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:02.705053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17eca6c4-2b9a-452e-ac55-d43cbf1272c2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.705723 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17eca6c4-2b9a-452e-ac55-d43cbf1272c2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.706672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17eca6c4-2b9a-452e-ac55-d43cbf1272c2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.707785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17eca6c4-2b9a-452e-ac55-d43cbf1272c2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.920402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-17eca6c4-2b9a-452e-ac55-d43cbf1272c2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:02.928501 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-17eca6c4-2b9a-452e-ac55-d43cbf1272c2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1507 microversion: 2.1 time: 0.234393 Nov 08 17:40:02.929186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 127/243] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:02 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:02.949263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0b7556e1-4c0c-415d-8ef9-21411484941e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:02.952717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0b7556e1-4c0c-415d-8ef9-21411484941e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:02.954360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c13a92c-2c7b-4f53-a2e1-af7e495bf979"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:02.955757 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:02.960261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b7556e1-4c0c-415d-8ef9-21411484941e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.960707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b7556e1-4c0c-415d-8ef9-21411484941e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.961489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b7556e1-4c0c-415d-8ef9-21411484941e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.961976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b7556e1-4c0c-415d-8ef9-21411484941e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.963156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.964652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:02.966225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:02.966794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.058682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] HTTP exception thrown: Invalid volume: volume 9c13a92c-2c7b-4f53-a2e1-af7e495bf979 is already attached to instances: 32522c32-1bb6-42e0-aa78-570cdaebad68 Nov 08 17:40:03.064154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Returning 400 to user: Invalid volume: volume 9c13a92c-2c7b-4f53-a2e1-af7e495bf979 is already attached to instances: 32522c32-1bb6-42e0-aa78-570cdaebad68 {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:03.064154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9419510d-6109-4252-8523-b9bb5322b839 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113732 Nov 08 17:40:03.064154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 128/244] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:40:02 2021] POST /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 08 17:40:03.065684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1226798438", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:03.065801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0b7556e1-4c0c-415d-8ef9-21411484941e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 26210 microversion: 2.1 time: 0.124141 Nov 08 17:40:03.066315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 117/245] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:02 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 26210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:03.127130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bf46fd43-3580-4a9a-87f0-c12c1fd2494a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:03.128229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bf46fd43-3580-4a9a-87f0-c12c1fd2494a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:03.133165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.network.neutron [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] validate_networks() for None {{(pid=127762) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:40:03.143994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bf46fd43-3580-4a9a-87f0-c12c1fd2494a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.145704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bf46fd43-3580-4a9a-87f0-c12c1fd2494a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.146771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bf46fd43-3580-4a9a-87f0-c12c1fd2494a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.148023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bf46fd43-3580-4a9a-87f0-c12c1fd2494a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.336671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-bf46fd43-3580-4a9a-87f0-c12c1fd2494a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lazy-loading 'services' on Instance uuid 32522c32-1bb6-42e0-aa78-570cdaebad68 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:40:03.451884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Flavor limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:40:03.453163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Image limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:40:03.454072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Flavor pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:40:03.454656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Image pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:40:03.455255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:40:03.467718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.468710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.469949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.470784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.494887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Getting quotas for project 2e75ece2b2c7421b827f4bce8c2fa189. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:40:03.498995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Getting quotas for user 0aaea1e512ce47bda322c0abbf20db95 and project 2e75ece2b2c7421b827f4bce8c2fa189. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:40:03.511709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Going to run 1 instances... {{(pid=127762) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:40:03.514854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:40:03.705078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bf46fd43-3580-4a9a-87f0-c12c1fd2494a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments/9c13a92c-2c7b-4f53-a2e1-af7e495bf979" status: 202 len: 0 microversion: 2.1 time: 0.583556 Nov 08 17:40:03.706062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 118/246] 10.222.0.18 () {58 vars in 1415 bytes} [Mon Nov 8 17:40:03 2021] DELETE /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments/9c13a92c-2c7b-4f53-a2e1-af7e495bf979 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:03.712454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ae22e530-9cf0-4582-9be9-7afe5fd32361 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:03.714031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ae22e530-9cf0-4582-9be9-7afe5fd32361 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:03.730332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9820e869-8f6a-4d6b-8aef-4fe48901c87c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668673 Nov 08 17:40:03.738939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 129/247] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:40:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:40:03.750673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bba89c23-6635-47ee-96f2-b63a909a37a0 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:03.751756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bba89c23-6635-47ee-96f2-b63a909a37a0 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:03.762392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bba89c23-6635-47ee-96f2-b63a909a37a0 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.763020 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bba89c23-6635-47ee-96f2-b63a909a37a0 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.764022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bba89c23-6635-47ee-96f2-b63a909a37a0 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.764522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bba89c23-6635-47ee-96f2-b63a909a37a0 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.911272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae22e530-9cf0-4582-9be9-7afe5fd32361 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.912095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae22e530-9cf0-4582-9be9-7afe5fd32361 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.914240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bba89c23-6635-47ee-96f2-b63a909a37a0 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:03.914491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae22e530-9cf0-4582-9be9-7afe5fd32361 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.916383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae22e530-9cf0-4582-9be9-7afe5fd32361 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.927354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bba89c23-6635-47ee-96f2-b63a909a37a0 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1274 microversion: 2.1 time: 0.183185 Nov 08 17:40:03.928187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 130/248] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:03 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:03.942097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e71a2247-27ff-4c2c-90aa-70d146dab509 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:03.956681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e71a2247-27ff-4c2c-90aa-70d146dab509 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:03.971451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e71a2247-27ff-4c2c-90aa-70d146dab509 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.974964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e71a2247-27ff-4c2c-90aa-70d146dab509 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:03.978914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e71a2247-27ff-4c2c-90aa-70d146dab509 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:03.983052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e71a2247-27ff-4c2c-90aa-70d146dab509 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:04.029771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e71a2247-27ff-4c2c-90aa-70d146dab509 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100427 Nov 08 17:40:04.031068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 131/249] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:03 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:04.036819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-26144951-bfba-41bd-8164-3e4bff6e4f7b tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:04.037884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-26144951-bfba-41bd-8164-3e4bff6e4f7b tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:04.050379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ae22e530-9cf0-4582-9be9-7afe5fd32361 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 25190 microversion: 2.20 time: 0.342022 Nov 08 17:40:04.051495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 119/250] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:03 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 25190 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:04.078742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8db27bc3-17cd-43dc-8e68-de094b32c997 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:04.080367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8db27bc3-17cd-43dc-8e68-de094b32c997 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:04.089052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8db27bc3-17cd-43dc-8e68-de094b32c997 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:04.089779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8db27bc3-17cd-43dc-8e68-de094b32c997 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:04.090840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8db27bc3-17cd-43dc-8e68-de094b32c997 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:04.092036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8db27bc3-17cd-43dc-8e68-de094b32c997 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:04.122670 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26144951-bfba-41bd-8164-3e4bff6e4f7b tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:04.127631 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-26144951-bfba-41bd-8164-3e4bff6e4f7b tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1215 microversion: 2.1 time: 0.095286 Nov 08 17:40:04.128389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 132/251] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:04 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:04.183456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8db27bc3-17cd-43dc-8e68-de094b32c997 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 26985 microversion: 2.1 time: 0.108992 Nov 08 17:40:04.184670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 120/252] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:04 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 26985 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:40:04.205775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:04.206380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:04.212934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:04.213381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:04.216176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:04.216176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:04.229546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] HTTP exception thrown: Instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 could not be found. Nov 08 17:40:04.230585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Returning 404 to user: Instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:04.231692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9635d3cc-2d94-45ab-84df-f2e16cb2bbe2 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 404 len: 111 microversion: 2.1 time: 0.029689 Nov 08 17:40:04.231944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 133/253] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:40:04 2021] DELETE /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:40:04.242094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:04.242510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] [instance: 7fce4e35-eea4-4afa-8842-ca97bcde50b8] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:04.250021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:04.251261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:04.251261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:04.251908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:04.266357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] HTTP exception thrown: Instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 could not be found. Nov 08 17:40:04.266988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] Returning 404 to user: Instance 7fce4e35-eea4-4afa-8842-ca97bcde50b8 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:04.267827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-94cb4449-9b16-47d8-8754-98d5db6e5233 tempest-DeleteServersTestJSON-540619801 tempest-DeleteServersTestJSON-540619801-project] 10.222.0.18 "GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8" status: 404 len: 111 microversion: 2.1 time: 0.031144 Nov 08 17:40:04.273285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 121/254] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:04 2021] GET /compute/v2.1/servers/7fce4e35-eea4-4afa-8842-ca97bcde50b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:40:04.945984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-886a354d-78e4-457d-a193-e20e77605c7c tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:04.947209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-886a354d-78e4-457d-a193-e20e77605c7c tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:04.953949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-886a354d-78e4-457d-a193-e20e77605c7c tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:04.954318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-886a354d-78e4-457d-a193-e20e77605c7c tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:04.958942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-886a354d-78e4-457d-a193-e20e77605c7c tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:04.958942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-886a354d-78e4-457d-a193-e20e77605c7c tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.047336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aa3e6cb0-4c56-4f37-9073-5004169a129c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:05.048867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aa3e6cb0-4c56-4f37-9073-5004169a129c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:05.059737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa3e6cb0-4c56-4f37-9073-5004169a129c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.060320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa3e6cb0-4c56-4f37-9073-5004169a129c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.061196 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa3e6cb0-4c56-4f37-9073-5004169a129c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.061838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa3e6cb0-4c56-4f37-9073-5004169a129c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.095179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aa3e6cb0-4c56-4f37-9073-5004169a129c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054845 Nov 08 17:40:05.095906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 122/255] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:05 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:40:05.101729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-43dc65d8-a81a-41bc-bb0e-a190a30b58e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:05.102687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-43dc65d8-a81a-41bc-bb0e-a190a30b58e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:05.109409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-43dc65d8-a81a-41bc-bb0e-a190a30b58e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.109906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-43dc65d8-a81a-41bc-bb0e-a190a30b58e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.110748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-43dc65d8-a81a-41bc-bb0e-a190a30b58e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.111185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-43dc65d8-a81a-41bc-bb0e-a190a30b58e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.193778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-43dc65d8-a81a-41bc-bb0e-a190a30b58e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 26369 microversion: 2.20 time: 0.095871 Nov 08 17:40:05.202439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 123/256] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:05 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 26369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:05.216133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cd3972dc-1aaa-4720-94d0-d4551f1fdc63 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:05.216502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cd3972dc-1aaa-4720-94d0-d4551f1fdc63 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:05.228348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cd3972dc-1aaa-4720-94d0-d4551f1fdc63 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.229018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cd3972dc-1aaa-4720-94d0-d4551f1fdc63 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.230334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cd3972dc-1aaa-4720-94d0-d4551f1fdc63 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.231180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cd3972dc-1aaa-4720-94d0-d4551f1fdc63 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.353666 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cd3972dc-1aaa-4720-94d0-d4551f1fdc63 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:05.365907 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cd3972dc-1aaa-4720-94d0-d4551f1fdc63 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1219 microversion: 2.1 time: 0.157167 Nov 08 17:40:05.367137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 124/257] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:05 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:05.376914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-400934a6-5c87-48b2-9e83-12770d23eba1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:05.384366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-400934a6-5c87-48b2-9e83-12770d23eba1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:05.392276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-400934a6-5c87-48b2-9e83-12770d23eba1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.392874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-400934a6-5c87-48b2-9e83-12770d23eba1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.394064 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-400934a6-5c87-48b2-9e83-12770d23eba1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.395483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-400934a6-5c87-48b2-9e83-12770d23eba1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.404140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-886a354d-78e4-457d-a193-e20e77605c7c tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:05.412506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-886a354d-78e4-457d-a193-e20e77605c7c tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1314 microversion: 2.1 time: 0.470236 Nov 08 17:40:05.422757 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 134/258] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:04 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:05.489199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-400934a6-5c87-48b2-9e83-12770d23eba1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 27543 microversion: 2.1 time: 0.119318 Nov 08 17:40:05.493468 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 125/259] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:05 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 27543 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:05.951257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-7e2c86de-00c5-4afa-8923-ec94779726f4 req-93408eeb-246c-4d15-8c9d-129909e3e334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d648d192-99df-4847-aa2b-8e360c43a3f2", "tag": "0e63b98d-e406-49f7-b96d-9d8927ad368d"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:05.953417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:05.953417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:05.961390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-7e2c86de-00c5-4afa-8923-ec94779726f4 req-93408eeb-246c-4d15-8c9d-129909e3e334 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:05.961826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-7e2c86de-00c5-4afa-8923-ec94779726f4 req-93408eeb-246c-4d15-8c9d-129909e3e334 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:05.978955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-7e2c86de-00c5-4afa-8923-ec94779726f4 req-93408eeb-246c-4d15-8c9d-129909e3e334 service nova] Creating event network-changed:0e63b98d-e406-49f7-b96d-9d8927ad368d for instance d648d192-99df-4847-aa2b-8e360c43a3f2 on hv-cinder-81689 Nov 08 17:40:05.983466 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-7e2c86de-00c5-4afa-8923-ec94779726f4 req-93408eeb-246c-4d15-8c9d-129909e3e334 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036011 Nov 08 17:40:05.984049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 135/260] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:06.107766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9a9bfb0a-9124-4001-8247-05cf1408cd07 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:06.108826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9a9bfb0a-9124-4001-8247-05cf1408cd07 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:06.117038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a9bfb0a-9124-4001-8247-05cf1408cd07 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.124367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a9bfb0a-9124-4001-8247-05cf1408cd07 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.124367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a9bfb0a-9124-4001-8247-05cf1408cd07 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.124367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a9bfb0a-9124-4001-8247-05cf1408cd07 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.170188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9a9bfb0a-9124-4001-8247-05cf1408cd07 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066975 Nov 08 17:40:06.170806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 126/261] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:06 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:40:06.208988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-83af1594-b5e8-4909-9f6e-659fb7e18abe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:06.210607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-83af1594-b5e8-4909-9f6e-659fb7e18abe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:06.219454 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83af1594-b5e8-4909-9f6e-659fb7e18abe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.220244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83af1594-b5e8-4909-9f6e-659fb7e18abe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.221105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83af1594-b5e8-4909-9f6e-659fb7e18abe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.221752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83af1594-b5e8-4909-9f6e-659fb7e18abe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.359119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-83af1594-b5e8-4909-9f6e-659fb7e18abe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 27205 microversion: 2.20 time: 0.154856 Nov 08 17:40:06.362515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 136/262] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:06 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 27205 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:06.391727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2972dd57-6890-4130-9580-b5e3e3083b1e tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:06.392326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2972dd57-6890-4130-9580-b5e3e3083b1e tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:06.399213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2972dd57-6890-4130-9580-b5e3e3083b1e tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.399887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2972dd57-6890-4130-9580-b5e3e3083b1e tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.400911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2972dd57-6890-4130-9580-b5e3e3083b1e tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.401545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2972dd57-6890-4130-9580-b5e3e3083b1e tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.431095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-14cc8da0-8943-4dfe-a7bc-d51b990b9653 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:06.431846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-14cc8da0-8943-4dfe-a7bc-d51b990b9653 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:06.445203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14cc8da0-8943-4dfe-a7bc-d51b990b9653 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.445730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14cc8da0-8943-4dfe-a7bc-d51b990b9653 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.446554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14cc8da0-8943-4dfe-a7bc-d51b990b9653 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.448969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14cc8da0-8943-4dfe-a7bc-d51b990b9653 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.483074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2972dd57-6890-4130-9580-b5e3e3083b1e tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:06.492604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2972dd57-6890-4130-9580-b5e3e3083b1e tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1267 microversion: 2.1 time: 0.104123 Nov 08 17:40:06.493900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 127/263] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:06 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:06.507052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-210304085", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "networks": [{"uuid": "7538bf23-b616-4166-98b8-7a0c2b2bdf89"}]}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:06.584401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] validate_networks() for [('7538bf23-b616-4166-98b8-7a0c2b2bdf89', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:40:06.908752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-14cc8da0-8943-4dfe-a7bc-d51b990b9653 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:06.922438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-14cc8da0-8943-4dfe-a7bc-d51b990b9653 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1314 microversion: 2.1 time: 0.496544 Nov 08 17:40:06.927739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 137/264] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:06 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:06.937567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2a609113-5640-4a00-b4fc-93bfb4c6da86 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:06.938914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2a609113-5640-4a00-b4fc-93bfb4c6da86 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:06.952099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2a609113-5640-4a00-b4fc-93bfb4c6da86 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.952720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2a609113-5640-4a00-b4fc-93bfb4c6da86 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:06.953957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2a609113-5640-4a00-b4fc-93bfb4c6da86 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:06.954477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2a609113-5640-4a00-b4fc-93bfb4c6da86 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:07.071068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2a609113-5640-4a00-b4fc-93bfb4c6da86 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 28030 microversion: 2.1 time: 0.140914 Nov 08 17:40:07.071710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 138/265] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:06 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 28030 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:07.278942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:40:07.279522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:40:07.279813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:40:07.280398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:40:07.280866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:40:07.291459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:07.292163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:07.292963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:07.293543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:07.312335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Getting quotas for project ef1c05515852427e84b12522c50545fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:40:07.317922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Getting quotas for user 6ca86df4b2b6476fae354e9e96fbdf53 and project ef1c05515852427e84b12522c50545fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:40:07.329997 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:40:07.333710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:40:07.377576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f7a161b9-69e7-4db7-99bd-9510209a259c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:07.379732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f7a161b9-69e7-4db7-99bd-9510209a259c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:07.387163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7a161b9-69e7-4db7-99bd-9510209a259c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:07.387889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7a161b9-69e7-4db7-99bd-9510209a259c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:07.388907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7a161b9-69e7-4db7-99bd-9510209a259c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:07.389559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7a161b9-69e7-4db7-99bd-9510209a259c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:07.451418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-363dd5a4-e57e-4397-9c65-fa50a0edb078 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956077 Nov 08 17:40:07.452043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 128/266] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:40:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:40:07.463831 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e7b1ca96-ed27-4fc6-a567-f64bb350fda5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:07.464868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e7b1ca96-ed27-4fc6-a567-f64bb350fda5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:07.477762 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f7a161b9-69e7-4db7-99bd-9510209a259c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 27617 microversion: 2.20 time: 0.102264 Nov 08 17:40:07.478892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 139/267] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:07 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 27617 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:07.509991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1d4686d0-c73f-4806-b1f5-7fe8006ef0c7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:07.510743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1d4686d0-c73f-4806-b1f5-7fe8006ef0c7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:07.530534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d4686d0-c73f-4806-b1f5-7fe8006ef0c7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:07.530951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d4686d0-c73f-4806-b1f5-7fe8006ef0c7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:07.531746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d4686d0-c73f-4806-b1f5-7fe8006ef0c7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:07.532182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d4686d0-c73f-4806-b1f5-7fe8006ef0c7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:07.600534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e7b1ca96-ed27-4fc6-a567-f64bb350fda5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:07.607915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e7b1ca96-ed27-4fc6-a567-f64bb350fda5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1217 microversion: 2.1 time: 0.148337 Nov 08 17:40:07.608682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 129/268] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:07 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:07.661192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1d4686d0-c73f-4806-b1f5-7fe8006ef0c7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:07.674183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1d4686d0-c73f-4806-b1f5-7fe8006ef0c7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1273 microversion: 2.1 time: 0.167739 Nov 08 17:40:07.674818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 140/269] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:07 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:07.947160 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0fc306db-4ec0-4b60-b70c-aa7c1c6f7d3f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:07.947764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0fc306db-4ec0-4b60-b70c-aa7c1c6f7d3f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:07.957535 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0fc306db-4ec0-4b60-b70c-aa7c1c6f7d3f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:07.958068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0fc306db-4ec0-4b60-b70c-aa7c1c6f7d3f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:07.959277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0fc306db-4ec0-4b60-b70c-aa7c1c6f7d3f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:07.959865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0fc306db-4ec0-4b60-b70c-aa7c1c6f7d3f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.085514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f2f21f44-2ed0-4218-bc36-204d96858ee3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:08.094931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f2f21f44-2ed0-4218-bc36-204d96858ee3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:08.106789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2f21f44-2ed0-4218-bc36-204d96858ee3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:08.107237 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2f21f44-2ed0-4218-bc36-204d96858ee3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.108037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2f21f44-2ed0-4218-bc36-204d96858ee3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:08.109941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2f21f44-2ed0-4218-bc36-204d96858ee3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.238146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f2f21f44-2ed0-4218-bc36-204d96858ee3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 28149 microversion: 2.1 time: 0.156148 Nov 08 17:40:08.239802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 141/270] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:08 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 28149 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:40:08.381413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0fc306db-4ec0-4b60-b70c-aa7c1c6f7d3f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:08.389543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0fc306db-4ec0-4b60-b70c-aa7c1c6f7d3f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1314 microversion: 2.1 time: 0.446026 Nov 08 17:40:08.390116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 130/271] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:07 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:08.490260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d7f01e82-ee2f-4c69-afc5-da1997a3d404 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:08.492248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d7f01e82-ee2f-4c69-afc5-da1997a3d404 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:08.499654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7f01e82-ee2f-4c69-afc5-da1997a3d404 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:08.500332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7f01e82-ee2f-4c69-afc5-da1997a3d404 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.501116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7f01e82-ee2f-4c69-afc5-da1997a3d404 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:08.501723 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7f01e82-ee2f-4c69-afc5-da1997a3d404 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.606398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d7f01e82-ee2f-4c69-afc5-da1997a3d404 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 27916 microversion: 2.20 time: 0.117021 Nov 08 17:40:08.606398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 142/272] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:08 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 27916 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:08.626894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cb598b26-8967-4bba-8676-931eb88e5105 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:08.627504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cb598b26-8967-4bba-8676-931eb88e5105 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:08.634410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb598b26-8967-4bba-8676-931eb88e5105 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:08.635104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb598b26-8967-4bba-8676-931eb88e5105 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.636004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb598b26-8967-4bba-8676-931eb88e5105 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:08.636433 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb598b26-8967-4bba-8676-931eb88e5105 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.693299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3f9314b4-fa74-47b0-967a-045d8eca8558 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:08.694163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3f9314b4-fa74-47b0-967a-045d8eca8558 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:08.702226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f9314b4-fa74-47b0-967a-045d8eca8558 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:08.703396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f9314b4-fa74-47b0-967a-045d8eca8558 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.704335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f9314b4-fa74-47b0-967a-045d8eca8558 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:08.705325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f9314b4-fa74-47b0-967a-045d8eca8558 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:08.742655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cb598b26-8967-4bba-8676-931eb88e5105 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:08.750761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cb598b26-8967-4bba-8676-931eb88e5105 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1221 microversion: 2.1 time: 0.129514 Nov 08 17:40:08.754945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 131/273] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:08 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:08.939659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3f9314b4-fa74-47b0-967a-045d8eca8558 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:08.950876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3f9314b4-fa74-47b0-967a-045d8eca8558 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1315 microversion: 2.1 time: 0.261870 Nov 08 17:40:08.951787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 143/274] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:08 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:09.251167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8aeecf3d-bf9a-4ffa-8a90-c2f9fa634daf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:09.252422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8aeecf3d-bf9a-4ffa-8a90-c2f9fa634daf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:09.258593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8aeecf3d-bf9a-4ffa-8a90-c2f9fa634daf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.259274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8aeecf3d-bf9a-4ffa-8a90-c2f9fa634daf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.260273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8aeecf3d-bf9a-4ffa-8a90-c2f9fa634daf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.260873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8aeecf3d-bf9a-4ffa-8a90-c2f9fa634daf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.351418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8aeecf3d-bf9a-4ffa-8a90-c2f9fa634daf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 28440 microversion: 2.1 time: 0.103849 Nov 08 17:40:09.355340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 132/275] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:09 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 28440 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:09.406953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ea2ac310-f82c-4369-89e4-a2c8abe51182 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:09.407649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ea2ac310-f82c-4369-89e4-a2c8abe51182 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:09.415307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea2ac310-f82c-4369-89e4-a2c8abe51182 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.415957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea2ac310-f82c-4369-89e4-a2c8abe51182 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.417206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea2ac310-f82c-4369-89e4-a2c8abe51182 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.417783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea2ac310-f82c-4369-89e4-a2c8abe51182 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.615791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f9be96f7-7608-4dcf-9402-504f320a0e2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:09.616903 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f9be96f7-7608-4dcf-9402-504f320a0e2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:09.629679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9be96f7-7608-4dcf-9402-504f320a0e2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.629679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9be96f7-7608-4dcf-9402-504f320a0e2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.629679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9be96f7-7608-4dcf-9402-504f320a0e2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.630050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9be96f7-7608-4dcf-9402-504f320a0e2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.671767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ea2ac310-f82c-4369-89e4-a2c8abe51182 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:09.686964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ea2ac310-f82c-4369-89e4-a2c8abe51182 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1314 microversion: 2.1 time: 0.281530 Nov 08 17:40:09.688449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 144/276] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:09 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:09.711599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-93b33b0e-d1b8-4189-9398-46a268b797e3 req-bf7a0825-523d-48bc-a829-f7394b287821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23440014-4f2c-41f4-ae48-24c2c9ea50da", "tag": "1e45840d-466e-4a14-8434-90b94be70955"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:09.714157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:09.714157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:09.714802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f9be96f7-7608-4dcf-9402-504f320a0e2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 28163 microversion: 2.20 time: 0.102228 Nov 08 17:40:09.715812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 133/277] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:09 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 28163 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:09.723567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-93b33b0e-d1b8-4189-9398-46a268b797e3 req-bf7a0825-523d-48bc-a829-f7394b287821 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.724252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-93b33b0e-d1b8-4189-9398-46a268b797e3 req-bf7a0825-523d-48bc-a829-f7394b287821 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.739087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-93b33b0e-d1b8-4189-9398-46a268b797e3 req-bf7a0825-523d-48bc-a829-f7394b287821 service nova] Creating event network-changed:1e45840d-466e-4a14-8434-90b94be70955 for instance 23440014-4f2c-41f4-ae48-24c2c9ea50da on hv-cinder-81689 Nov 08 17:40:09.746488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-93b33b0e-d1b8-4189-9398-46a268b797e3 req-bf7a0825-523d-48bc-a829-f7394b287821 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042278 Nov 08 17:40:09.748066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 145/278] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:09.773792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1a6f8f4e-18fe-404d-8523-79fc58458154 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:09.774722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1a6f8f4e-18fe-404d-8523-79fc58458154 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:09.787146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a6f8f4e-18fe-404d-8523-79fc58458154 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.787822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a6f8f4e-18fe-404d-8523-79fc58458154 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.788647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a6f8f4e-18fe-404d-8523-79fc58458154 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.789287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a6f8f4e-18fe-404d-8523-79fc58458154 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.863513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1a6f8f4e-18fe-404d-8523-79fc58458154 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:09.871646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1a6f8f4e-18fe-404d-8523-79fc58458154 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1269 microversion: 2.1 time: 0.102683 Nov 08 17:40:09.872250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 134/279] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:09 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1269 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:09.973378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-19a6f97b-2907-4223-82cf-a4cfe1fd1070 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:09.977053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-19a6f97b-2907-4223-82cf-a4cfe1fd1070 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:09.995517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19a6f97b-2907-4223-82cf-a4cfe1fd1070 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.998065 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19a6f97b-2907-4223-82cf-a4cfe1fd1070 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:09.999128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19a6f97b-2907-4223-82cf-a4cfe1fd1070 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:09.999565 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19a6f97b-2907-4223-82cf-a4cfe1fd1070 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:10.223442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-19a6f97b-2907-4223-82cf-a4cfe1fd1070 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:10.231173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-19a6f97b-2907-4223-82cf-a4cfe1fd1070 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1315 microversion: 2.1 time: 0.266398 Nov 08 17:40:10.234295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 146/280] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:09 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:10.364156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ee4dad24-8405-41d9-b630-850b5f1f4801 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:10.365187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ee4dad24-8405-41d9-b630-850b5f1f4801 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:10.372670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee4dad24-8405-41d9-b630-850b5f1f4801 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:10.373335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee4dad24-8405-41d9-b630-850b5f1f4801 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:10.374325 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee4dad24-8405-41d9-b630-850b5f1f4801 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:10.374873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee4dad24-8405-41d9-b630-850b5f1f4801 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:10.463751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ee4dad24-8405-41d9-b630-850b5f1f4801 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 28441 microversion: 2.1 time: 0.104072 Nov 08 17:40:10.465029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 135/281] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:10 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 28441 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:10.705429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a341afb3-27e3-4d4e-a8c5-480c21120c8d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:10.706103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a341afb3-27e3-4d4e-a8c5-480c21120c8d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:10.712966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a341afb3-27e3-4d4e-a8c5-480c21120c8d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:10.713490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a341afb3-27e3-4d4e-a8c5-480c21120c8d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:10.714866 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a341afb3-27e3-4d4e-a8c5-480c21120c8d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:10.715393 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a341afb3-27e3-4d4e-a8c5-480c21120c8d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:10.732498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-222e20bb-4e25-4eb8-9c9c-05e28679a71b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:10.735704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-222e20bb-4e25-4eb8-9c9c-05e28679a71b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:10.748843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-222e20bb-4e25-4eb8-9c9c-05e28679a71b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:10.749579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-222e20bb-4e25-4eb8-9c9c-05e28679a71b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:10.751348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-222e20bb-4e25-4eb8-9c9c-05e28679a71b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:10.752640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-222e20bb-4e25-4eb8-9c9c-05e28679a71b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:10.859629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-222e20bb-4e25-4eb8-9c9c-05e28679a71b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 28454 microversion: 2.20 time: 0.135344 Nov 08 17:40:10.860939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 136/282] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:10 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 28454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:10.889686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ebb120eb-024b-4cf8-9fcf-147f474c964a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:10.890729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ebb120eb-024b-4cf8-9fcf-147f474c964a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:10.897952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebb120eb-024b-4cf8-9fcf-147f474c964a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:10.898304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebb120eb-024b-4cf8-9fcf-147f474c964a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:10.899435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebb120eb-024b-4cf8-9fcf-147f474c964a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:10.899941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebb120eb-024b-4cf8-9fcf-147f474c964a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:11.008482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ebb120eb-024b-4cf8-9fcf-147f474c964a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:11.017698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ebb120eb-024b-4cf8-9fcf-147f474c964a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1275 microversion: 2.1 time: 0.132187 Nov 08 17:40:11.019819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 137/283] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:10 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:11.024245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a341afb3-27e3-4d4e-a8c5-480c21120c8d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:11.031619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a341afb3-27e3-4d4e-a8c5-480c21120c8d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1314 microversion: 2.1 time: 0.330774 Nov 08 17:40:11.032553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 147/284] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:10 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:11.251060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6e86a518-acf1-425e-b8cf-877c4a356538 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:11.252034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6e86a518-acf1-425e-b8cf-877c4a356538 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:11.260875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e86a518-acf1-425e-b8cf-877c4a356538 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:11.261579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e86a518-acf1-425e-b8cf-877c4a356538 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:11.263976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e86a518-acf1-425e-b8cf-877c4a356538 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:11.263976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e86a518-acf1-425e-b8cf-877c4a356538 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:11.476888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6bd540fa-b119-4644-8743-aed09c15018d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:11.478828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6bd540fa-b119-4644-8743-aed09c15018d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:11.485017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bd540fa-b119-4644-8743-aed09c15018d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:11.490221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bd540fa-b119-4644-8743-aed09c15018d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:11.491158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bd540fa-b119-4644-8743-aed09c15018d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:11.493012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bd540fa-b119-4644-8743-aed09c15018d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:11.508139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6e86a518-acf1-425e-b8cf-877c4a356538 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:11.518362 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6e86a518-acf1-425e-b8cf-877c4a356538 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1315 microversion: 2.1 time: 0.271324 Nov 08 17:40:11.529279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 138/285] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:11 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:11.595783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6bd540fa-b119-4644-8743-aed09c15018d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 28608 microversion: 2.1 time: 0.123258 Nov 08 17:40:11.597291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 148/286] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:11 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 28608 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:40:11.872906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d0765bfa-ebd8-4194-ae32-99b553e34ac3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:11.873826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d0765bfa-ebd8-4194-ae32-99b553e34ac3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:11.885613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0765bfa-ebd8-4194-ae32-99b553e34ac3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:11.886255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0765bfa-ebd8-4194-ae32-99b553e34ac3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:11.887335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0765bfa-ebd8-4194-ae32-99b553e34ac3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:11.887920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0765bfa-ebd8-4194-ae32-99b553e34ac3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.005887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d0765bfa-ebd8-4194-ae32-99b553e34ac3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 28454 microversion: 2.20 time: 0.136529 Nov 08 17:40:12.006648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 139/287] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:11 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 28454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:12.036922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d0164a5f-7206-4e11-8033-b19601a3cb9e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:12.037615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d0164a5f-7206-4e11-8033-b19601a3cb9e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:12.044661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0164a5f-7206-4e11-8033-b19601a3cb9e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.045100 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0164a5f-7206-4e11-8033-b19601a3cb9e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.046079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0164a5f-7206-4e11-8033-b19601a3cb9e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.046531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0164a5f-7206-4e11-8033-b19601a3cb9e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.049575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ec62e1a9-61ad-430d-934c-6cd698d49e94 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:12.053692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ec62e1a9-61ad-430d-934c-6cd698d49e94 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:12.059929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec62e1a9-61ad-430d-934c-6cd698d49e94 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.060375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec62e1a9-61ad-430d-934c-6cd698d49e94 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.061754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec62e1a9-61ad-430d-934c-6cd698d49e94 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.061754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec62e1a9-61ad-430d-934c-6cd698d49e94 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.487758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d0164a5f-7206-4e11-8033-b19601a3cb9e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:12.487758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d0164a5f-7206-4e11-8033-b19601a3cb9e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.378996 Nov 08 17:40:12.487758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 149/288] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:12 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:12.489442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-0ec79246-49ab-490b-aaa1-c3bab44e1d79 req-2f7dd536-d785-451d-b597-f3724829310d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d648d192-99df-4847-aa2b-8e360c43a3f2", "name": "network-vif-plugged", "status": "completed", "tag": "0e63b98d-e406-49f7-b96d-9d8927ad368d"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:12.489442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:12.489442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:12.490004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ec62e1a9-61ad-430d-934c-6cd698d49e94 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:12.490577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-0ec79246-49ab-490b-aaa1-c3bab44e1d79 req-2f7dd536-d785-451d-b597-f3724829310d service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.490577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-0ec79246-49ab-490b-aaa1-c3bab44e1d79 req-2f7dd536-d785-451d-b597-f3724829310d service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.491209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ec62e1a9-61ad-430d-934c-6cd698d49e94 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1314 microversion: 2.1 time: 0.388375 Nov 08 17:40:12.491209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 140/289] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:12 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:12.537309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9b1d1e85-7d73-465a-b2a5-93b590bf54b1 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:12.538155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9b1d1e85-7d73-465a-b2a5-93b590bf54b1 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:12.544389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b1d1e85-7d73-465a-b2a5-93b590bf54b1 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.544963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b1d1e85-7d73-465a-b2a5-93b590bf54b1 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.545833 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b1d1e85-7d73-465a-b2a5-93b590bf54b1 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.546649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b1d1e85-7d73-465a-b2a5-93b590bf54b1 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.633367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-0ec79246-49ab-490b-aaa1-c3bab44e1d79 req-2f7dd536-d785-451d-b597-f3724829310d service nova] Creating event network-vif-plugged:0e63b98d-e406-49f7-b96d-9d8927ad368d for instance d648d192-99df-4847-aa2b-8e360c43a3f2 on hv-cinder-81689 Nov 08 17:40:12.643315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-0ec79246-49ab-490b-aaa1-c3bab44e1d79 req-2f7dd536-d785-451d-b597-f3724829310d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229160 Nov 08 17:40:12.645120 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 150/290] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:12.653999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7bfaae79-00cf-41ea-9883-f774fcf2037e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:12.655699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7bfaae79-00cf-41ea-9883-f774fcf2037e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:12.665879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7bfaae79-00cf-41ea-9883-f774fcf2037e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.667151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7bfaae79-00cf-41ea-9883-f774fcf2037e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.668255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7bfaae79-00cf-41ea-9883-f774fcf2037e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.669092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7bfaae79-00cf-41ea-9883-f774fcf2037e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.806758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7bfaae79-00cf-41ea-9883-f774fcf2037e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 28608 microversion: 2.1 time: 0.159076 Nov 08 17:40:12.808356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 151/291] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:12 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 28608 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:12.814495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-a67b3772-1a94-4461-962a-918b256bde46 req-7f120226-66c5-4df7-927a-48e20a7d365f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4f5525-8b55-43ab-a990-9d151f90f74a", "tag": "be2a67f9-fef7-4f3a-849f-362d77b76ae3"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:12.816874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:12.816874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:12.832692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-a67b3772-1a94-4461-962a-918b256bde46 req-7f120226-66c5-4df7-927a-48e20a7d365f service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:12.832692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-a67b3772-1a94-4461-962a-918b256bde46 req-7f120226-66c5-4df7-927a-48e20a7d365f service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:12.854111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-a67b3772-1a94-4461-962a-918b256bde46 req-7f120226-66c5-4df7-927a-48e20a7d365f service nova] Creating event network-changed:be2a67f9-fef7-4f3a-849f-362d77b76ae3 for instance 5f4f5525-8b55-43ab-a990-9d151f90f74a on hv-cinder-81689 Nov 08 17:40:12.860364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-a67b3772-1a94-4461-962a-918b256bde46 req-7f120226-66c5-4df7-927a-48e20a7d365f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050898 Nov 08 17:40:12.860717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 152/292] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:13.020043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-534a27d4-85d7-4fc6-bede-0169346e83fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:13.021210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-534a27d4-85d7-4fc6-bede-0169346e83fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:13.029323 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-534a27d4-85d7-4fc6-bede-0169346e83fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:13.030109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-534a27d4-85d7-4fc6-bede-0169346e83fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:13.031653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-534a27d4-85d7-4fc6-bede-0169346e83fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:13.032324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-534a27d4-85d7-4fc6-bede-0169346e83fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:13.128432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-534a27d4-85d7-4fc6-bede-0169346e83fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 28622 microversion: 2.20 time: 0.113724 Nov 08 17:40:13.129817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 153/293] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:13 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 28622 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:13.144759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9b1d1e85-7d73-465a-b2a5-93b590bf54b1 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:13.158220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9b1d1e85-7d73-465a-b2a5-93b590bf54b1 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1315 microversion: 2.1 time: 0.625498 Nov 08 17:40:13.159420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 141/294] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:12 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:13.481428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c3794ea3-3bd2-49fb-aa10-ae4d0c72fe1a tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:13.481665 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-447a365e-cb97-41b3-a5cd-91151bf7b279 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:13.482184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-447a365e-cb97-41b3-a5cd-91151bf7b279 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:13.482297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c3794ea3-3bd2-49fb-aa10-ae4d0c72fe1a tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:13.489554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c3794ea3-3bd2-49fb-aa10-ae4d0c72fe1a tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:13.489745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-447a365e-cb97-41b3-a5cd-91151bf7b279 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:13.490133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-447a365e-cb97-41b3-a5cd-91151bf7b279 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:13.490479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c3794ea3-3bd2-49fb-aa10-ae4d0c72fe1a tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:13.490960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-447a365e-cb97-41b3-a5cd-91151bf7b279 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:13.491411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-447a365e-cb97-41b3-a5cd-91151bf7b279 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:13.491644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c3794ea3-3bd2-49fb-aa10-ae4d0c72fe1a tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:13.494717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c3794ea3-3bd2-49fb-aa10-ae4d0c72fe1a tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:13.874122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-447a365e-cb97-41b3-a5cd-91151bf7b279 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:13.884338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-447a365e-cb97-41b3-a5cd-91151bf7b279 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.406768 Nov 08 17:40:13.885459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 154/295] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:13 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:13.886284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c3794ea3-3bd2-49fb-aa10-ae4d0c72fe1a tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:13.892732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cc9cef8f-480f-4767-a2d7-fd672614a524 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:13.893979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cc9cef8f-480f-4767-a2d7-fd672614a524 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:13.896463 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c3794ea3-3bd2-49fb-aa10-ae4d0c72fe1a tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1314 microversion: 2.1 time: 0.416418 Nov 08 17:40:13.898447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 142/296] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:13 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:13.912974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc9cef8f-480f-4767-a2d7-fd672614a524 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:13.913652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc9cef8f-480f-4767-a2d7-fd672614a524 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:13.914657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc9cef8f-480f-4767-a2d7-fd672614a524 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:13.915644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc9cef8f-480f-4767-a2d7-fd672614a524 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:14.008172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cc9cef8f-480f-4767-a2d7-fd672614a524 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 28608 microversion: 2.1 time: 0.121300 Nov 08 17:40:14.009649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 155/297] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:13 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 28608 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:14.141467 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-744a4637-bc7e-4b95-9911-685c0c2b9a34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:14.142602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-744a4637-bc7e-4b95-9911-685c0c2b9a34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:14.156960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-744a4637-bc7e-4b95-9911-685c0c2b9a34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:14.157695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-744a4637-bc7e-4b95-9911-685c0c2b9a34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:14.164809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-744a4637-bc7e-4b95-9911-685c0c2b9a34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:14.165291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-744a4637-bc7e-4b95-9911-685c0c2b9a34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:14.180365 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-61529c28-78f6-4dce-9d0f-57dce2f21954 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:14.181833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-61529c28-78f6-4dce-9d0f-57dce2f21954 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:14.206786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61529c28-78f6-4dce-9d0f-57dce2f21954 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:14.208077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61529c28-78f6-4dce-9d0f-57dce2f21954 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:14.209154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61529c28-78f6-4dce-9d0f-57dce2f21954 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:14.209797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61529c28-78f6-4dce-9d0f-57dce2f21954 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:14.262240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-744a4637-bc7e-4b95-9911-685c0c2b9a34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 28622 microversion: 2.20 time: 0.123393 Nov 08 17:40:14.266574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 143/298] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:14 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 28622 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:14.479646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-61529c28-78f6-4dce-9d0f-57dce2f21954 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:14.496523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-61529c28-78f6-4dce-9d0f-57dce2f21954 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1315 microversion: 2.1 time: 0.324531 Nov 08 17:40:14.506618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 156/299] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:14 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:14.902985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-03634e46-f229-4fee-bb4e-2c44bae0e3ef tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:14.903803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-03634e46-f229-4fee-bb4e-2c44bae0e3ef tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:14.915433 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03634e46-f229-4fee-bb4e-2c44bae0e3ef tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:14.918763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03634e46-f229-4fee-bb4e-2c44bae0e3ef tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:14.923333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8da56ff8-bed3-4bdd-9ff0-184352703ac7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:14.923482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03634e46-f229-4fee-bb4e-2c44bae0e3ef tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:14.923579 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8da56ff8-bed3-4bdd-9ff0-184352703ac7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:14.923671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03634e46-f229-4fee-bb4e-2c44bae0e3ef tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:14.930766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8da56ff8-bed3-4bdd-9ff0-184352703ac7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:14.931882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8da56ff8-bed3-4bdd-9ff0-184352703ac7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:14.932858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8da56ff8-bed3-4bdd-9ff0-184352703ac7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:14.933489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8da56ff8-bed3-4bdd-9ff0-184352703ac7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:15.379002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8da56ff8-bed3-4bdd-9ff0-184352703ac7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:15.387455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8da56ff8-bed3-4bdd-9ff0-184352703ac7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1497 microversion: 2.1 time: 0.475478 Nov 08 17:40:15.396606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 157/300] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:14 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1497 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:15.396971 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-03634e46-f229-4fee-bb4e-2c44bae0e3ef tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:15.397407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0ba10105-eec1-4e98-b043-a47cd99f9f72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:15.397407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0ba10105-eec1-4e98-b043-a47cd99f9f72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:15.400914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-03634e46-f229-4fee-bb4e-2c44bae0e3ef tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.502430 Nov 08 17:40:15.401486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 144/301] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:14 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:15.407286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8e27818a-ab45-4baf-9ef6-cad218662d30 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:15.408469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8e27818a-ab45-4baf-9ef6-cad218662d30 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:15.411654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ba10105-eec1-4e98-b043-a47cd99f9f72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:15.412088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ba10105-eec1-4e98-b043-a47cd99f9f72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:15.412887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ba10105-eec1-4e98-b043-a47cd99f9f72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:15.413320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ba10105-eec1-4e98-b043-a47cd99f9f72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:15.422830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8e27818a-ab45-4baf-9ef6-cad218662d30 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:15.422830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8e27818a-ab45-4baf-9ef6-cad218662d30 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:15.422830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8e27818a-ab45-4baf-9ef6-cad218662d30 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:15.422830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8e27818a-ab45-4baf-9ef6-cad218662d30 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:15.533821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0ba10105-eec1-4e98-b043-a47cd99f9f72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 28991 microversion: 2.1 time: 0.144152 Nov 08 17:40:15.536042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 158/302] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:15 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 28991 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:15.542536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8e27818a-ab45-4baf-9ef6-cad218662d30 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 28622 microversion: 2.20 time: 0.138725 Nov 08 17:40:15.550453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 145/303] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:15 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 28622 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:15.550614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3c6f923d-9758-466a-8c5a-b84fa156e032 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:15.550614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3c6f923d-9758-466a-8c5a-b84fa156e032 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:15.561107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c6f923d-9758-466a-8c5a-b84fa156e032 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:15.562113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c6f923d-9758-466a-8c5a-b84fa156e032 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:15.562995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c6f923d-9758-466a-8c5a-b84fa156e032 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:15.563493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c6f923d-9758-466a-8c5a-b84fa156e032 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:15.830951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3c6f923d-9758-466a-8c5a-b84fa156e032 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:15.840174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3c6f923d-9758-466a-8c5a-b84fa156e032 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1315 microversion: 2.1 time: 0.302588 Nov 08 17:40:15.851941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 159/304] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:15 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:16.420059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-23514119-a46a-48a8-8016-e9af3b0e99eb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:16.420617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-23514119-a46a-48a8-8016-e9af3b0e99eb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:16.428571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-23514119-a46a-48a8-8016-e9af3b0e99eb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.429029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-23514119-a46a-48a8-8016-e9af3b0e99eb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.430054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-23514119-a46a-48a8-8016-e9af3b0e99eb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.430681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-23514119-a46a-48a8-8016-e9af3b0e99eb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.547406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c36a4ee9-2aac-4410-8ba0-08b24b2bc848 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:16.548954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c36a4ee9-2aac-4410-8ba0-08b24b2bc848 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:16.562603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c36a4ee9-2aac-4410-8ba0-08b24b2bc848 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.563283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c36a4ee9-2aac-4410-8ba0-08b24b2bc848 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.564311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c36a4ee9-2aac-4410-8ba0-08b24b2bc848 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.567852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c36a4ee9-2aac-4410-8ba0-08b24b2bc848 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.670812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c36a4ee9-2aac-4410-8ba0-08b24b2bc848 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 30301 microversion: 2.1 time: 0.126369 Nov 08 17:40:16.671608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 160/305] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:16 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 30301 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:16.680332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-661436da-8312-4d8c-87ad-67efb054b2fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:16.682099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-661436da-8312-4d8c-87ad-67efb054b2fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:16.692369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-661436da-8312-4d8c-87ad-67efb054b2fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.693738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-661436da-8312-4d8c-87ad-67efb054b2fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.698213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-661436da-8312-4d8c-87ad-67efb054b2fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.699057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-661436da-8312-4d8c-87ad-67efb054b2fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.798938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-23514119-a46a-48a8-8016-e9af3b0e99eb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:16.802786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-661436da-8312-4d8c-87ad-67efb054b2fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 28622 microversion: 2.20 time: 0.126601 Nov 08 17:40:16.802786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 161/306] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:16 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 28622 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:16.807467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9a9f4aa2-de43-4636-a7b4-e0885ab44b3d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:16.807636 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-23514119-a46a-48a8-8016-e9af3b0e99eb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.392233 Nov 08 17:40:16.808559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9a9f4aa2-de43-4636-a7b4-e0885ab44b3d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:16.814876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 146/307] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:16 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:16.817114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a9f4aa2-de43-4636-a7b4-e0885ab44b3d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.817943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a9f4aa2-de43-4636-a7b4-e0885ab44b3d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.819075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a9f4aa2-de43-4636-a7b4-e0885ab44b3d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.819520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a9f4aa2-de43-4636-a7b4-e0885ab44b3d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.855580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-0960ed71-7d4c-4286-be65-9335abe156a5 req-bf2db117-c577-41bc-8ccd-e2083b2a0267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23440014-4f2c-41f4-ae48-24c2c9ea50da", "name": "network-vif-plugged", "status": "completed", "tag": "1e45840d-466e-4a14-8434-90b94be70955"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:16.857444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9a9f4aa2-de43-4636-a7b4-e0885ab44b3d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:40:16.858161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:16.858161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:40:16.872111 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-0960ed71-7d4c-4286-be65-9335abe156a5 req-bf2db117-c577-41bc-8ccd-e2083b2a0267 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.872986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-0960ed71-7d4c-4286-be65-9335abe156a5 req-bf2db117-c577-41bc-8ccd-e2083b2a0267 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.887548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-0960ed71-7d4c-4286-be65-9335abe156a5 req-bf2db117-c577-41bc-8ccd-e2083b2a0267 service nova] Creating event network-vif-plugged:1e45840d-466e-4a14-8434-90b94be70955 for instance 23440014-4f2c-41f4-ae48-24c2c9ea50da on hv-cinder-81689 Nov 08 17:40:16.900377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-0960ed71-7d4c-4286-be65-9335abe156a5 req-bf2db117-c577-41bc-8ccd-e2083b2a0267 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054336 Nov 08 17:40:16.900377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 147/308] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:16.904854 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ab3678fe-739f-435f-b857-d216b72faced tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:16.906272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ab3678fe-739f-435f-b857-d216b72faced tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:16.914600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ab3678fe-739f-435f-b857-d216b72faced tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.915384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ab3678fe-739f-435f-b857-d216b72faced tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:16.916984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ab3678fe-739f-435f-b857-d216b72faced tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:16.917625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ab3678fe-739f-435f-b857-d216b72faced tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.163965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ab3678fe-739f-435f-b857-d216b72faced tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:17.174525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ab3678fe-739f-435f-b857-d216b72faced tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1315 microversion: 2.1 time: 0.276073 Nov 08 17:40:17.175712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 148/309] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:16 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:17.331429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1399767629", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d2f8859-27fb-47a8-ac65-c24c1f69a55c"}]}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:17.360437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9a9f4aa2-de43-4636-a7b4-e0885ab44b3d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 204 len: 0 microversion: 2.1 time: 0.553270 Nov 08 17:40:17.360437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 162/310] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:40:16 2021] DELETE /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:40:17.380576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bab398e6-3568-4a4c-9540-5d874c248612 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:17.384016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bab398e6-3568-4a4c-9540-5d874c248612 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:17.398674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] validate_networks() for [('4d2f8859-27fb-47a8-ac65-c24c1f69a55c', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:40:17.413079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bab398e6-3568-4a4c-9540-5d874c248612 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:17.415794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bab398e6-3568-4a4c-9540-5d874c248612 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.417737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bab398e6-3568-4a4c-9540-5d874c248612 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:17.419517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bab398e6-3568-4a4c-9540-5d874c248612 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.689658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bab398e6-3568-4a4c-9540-5d874c248612 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:17.703862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bab398e6-3568-4a4c-9540-5d874c248612 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1503 microversion: 2.1 time: 0.340005 Nov 08 17:40:17.704867 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 163/311] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:17 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:17.711709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-05d0f46b-402a-46a5-b388-4e6305929c57 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:17.712836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-05d0f46b-402a-46a5-b388-4e6305929c57 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:17.719660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05d0f46b-402a-46a5-b388-4e6305929c57 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:17.721553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05d0f46b-402a-46a5-b388-4e6305929c57 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.723072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05d0f46b-402a-46a5-b388-4e6305929c57 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:17.723783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05d0f46b-402a-46a5-b388-4e6305929c57 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.883506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:40:17.884010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:40:17.884370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:40:17.884765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:40:17.885177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:40:17.895157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:17.895631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.896551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:17.896987 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.907918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-05d0f46b-402a-46a5-b388-4e6305929c57 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 31833 microversion: 2.1 time: 0.201675 Nov 08 17:40:17.908798 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 164/312] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:17 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 31833 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:17.914718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Getting quotas for project 50aa3caf30d841ae976d8ddb86d00a2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:40:17.916971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5c66eee4-4ab3-470f-befc-05a18f9e9699 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:17.918074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5c66eee4-4ab3-470f-befc-05a18f9e9699 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:17.918931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Getting quotas for user 828709bcff1644db887985ded838db9c and project 50aa3caf30d841ae976d8ddb86d00a2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:40:17.925316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c66eee4-4ab3-470f-befc-05a18f9e9699 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:17.926591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c66eee4-4ab3-470f-befc-05a18f9e9699 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.927380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c66eee4-4ab3-470f-befc-05a18f9e9699 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:17.927813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c66eee4-4ab3-470f-befc-05a18f9e9699 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:17.930933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:40:17.933256 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:40:18.009424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5c66eee4-4ab3-470f-befc-05a18f9e9699 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 28622 microversion: 2.20 time: 0.098194 Nov 08 17:40:18.010225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 165/313] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:17 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 28622 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:18.016208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a625031b-a1ea-4aaa-a2b2-84342df58b3f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:18.016971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a625031b-a1ea-4aaa-a2b2-84342df58b3f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:18.025634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a625031b-a1ea-4aaa-a2b2-84342df58b3f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:18.026162 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a625031b-a1ea-4aaa-a2b2-84342df58b3f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:18.027069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a625031b-a1ea-4aaa-a2b2-84342df58b3f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:18.027752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a625031b-a1ea-4aaa-a2b2-84342df58b3f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:18.107949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a6170bd4-02ff-41b4-afb9-54fb27d0894f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.930156 Nov 08 17:40:18.108704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 149/314] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:40:17 2021] POST /compute/v2.1/servers => generated 383 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:40:18.118946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2574e239-64ed-43e8-9b14-f9fca5ef5e5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:18.119548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2574e239-64ed-43e8-9b14-f9fca5ef5e5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:18.179979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a625031b-a1ea-4aaa-a2b2-84342df58b3f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:18.187448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a625031b-a1ea-4aaa-a2b2-84342df58b3f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.175131 Nov 08 17:40:18.188163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 166/315] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:18 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:18.197542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6ad5bb2e-9bb7-4ba8-8c33-67434fea2035 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:18.198161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6ad5bb2e-9bb7-4ba8-8c33-67434fea2035 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:18.200267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2574e239-64ed-43e8-9b14-f9fca5ef5e5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:18.204007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ad5bb2e-9bb7-4ba8-8c33-67434fea2035 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:18.204453 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ad5bb2e-9bb7-4ba8-8c33-67434fea2035 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:18.205239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ad5bb2e-9bb7-4ba8-8c33-67434fea2035 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:18.205664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ad5bb2e-9bb7-4ba8-8c33-67434fea2035 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:18.207294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2574e239-64ed-43e8-9b14-f9fca5ef5e5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1222 microversion: 2.1 time: 0.091639 Nov 08 17:40:18.216431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 150/316] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:18.306446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1194646799", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d2f8859-27fb-47a8-ac65-c24c1f69a55c"}]}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:18.394202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] validate_networks() for [('4d2f8859-27fb-47a8-ac65-c24c1f69a55c', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:40:18.395869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6ad5bb2e-9bb7-4ba8-8c33-67434fea2035 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:18.407238 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6ad5bb2e-9bb7-4ba8-8c33-67434fea2035 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1315 microversion: 2.1 time: 0.217357 Nov 08 17:40:18.408016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 167/317] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:18 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:18.730355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-77ceaf2a-7833-4d79-bb44-bc4a26043945 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:18.733190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-77ceaf2a-7833-4d79-bb44-bc4a26043945 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:18.745631 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77ceaf2a-7833-4d79-bb44-bc4a26043945 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:18.746452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77ceaf2a-7833-4d79-bb44-bc4a26043945 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:18.747760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77ceaf2a-7833-4d79-bb44-bc4a26043945 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:18.748520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77ceaf2a-7833-4d79-bb44-bc4a26043945 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:18.910476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:40:18.910914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:40:18.911203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:40:18.911657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:40:18.912117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:40:18.923204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:18.924319 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:18.927097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:18.927835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:18.950218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Getting quotas for project 50aa3caf30d841ae976d8ddb86d00a2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:40:18.968025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Getting quotas for user 828709bcff1644db887985ded838db9c and project 50aa3caf30d841ae976d8ddb86d00a2d. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:40:18.999047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-77ceaf2a-7833-4d79-bb44-bc4a26043945 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:19.004816 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:40:19.007199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:40:19.012761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-77ceaf2a-7833-4d79-bb44-bc4a26043945 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1503 microversion: 2.1 time: 0.292663 Nov 08 17:40:19.023593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 168/318] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:18 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:19.033802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-84ee48d6-4117-42ad-bc0e-b5f021ffc2da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:19.036260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-84ee48d6-4117-42ad-bc0e-b5f021ffc2da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:19.043004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84ee48d6-4117-42ad-bc0e-b5f021ffc2da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.044259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84ee48d6-4117-42ad-bc0e-b5f021ffc2da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.045386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84ee48d6-4117-42ad-bc0e-b5f021ffc2da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.046163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84ee48d6-4117-42ad-bc0e-b5f021ffc2da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.187042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-84ee48d6-4117-42ad-bc0e-b5f021ffc2da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 32595 microversion: 2.1 time: 0.162027 Nov 08 17:40:19.191346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 169/319] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:19 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 32595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:19.193082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c2daf0d6-4487-48ad-9a55-6b70464f738a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:19.194098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c2daf0d6-4487-48ad-9a55-6b70464f738a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:19.201032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2daf0d6-4487-48ad-9a55-6b70464f738a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.201470 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2daf0d6-4487-48ad-9a55-6b70464f738a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.202246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2daf0d6-4487-48ad-9a55-6b70464f738a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.202704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2daf0d6-4487-48ad-9a55-6b70464f738a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.248450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-466bbd6d-bc3e-48fe-955f-b4979da29b4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.946582 Nov 08 17:40:19.249206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 151/320] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:40:18 2021] POST /compute/v2.1/servers => generated 383 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:40:19.259878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-888c100b-a1f9-4df2-a490-85cc33e3a4e7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:19.260954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-888c100b-a1f9-4df2-a490-85cc33e3a4e7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:19.268329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888c100b-a1f9-4df2-a490-85cc33e3a4e7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.269015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888c100b-a1f9-4df2-a490-85cc33e3a4e7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.270336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888c100b-a1f9-4df2-a490-85cc33e3a4e7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.270891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888c100b-a1f9-4df2-a490-85cc33e3a4e7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.312850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c2daf0d6-4487-48ad-9a55-6b70464f738a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 29472 microversion: 2.20 time: 0.123210 Nov 08 17:40:19.313717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 170/321] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:19 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 29472 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:19.327289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-11b64907-8c2c-4b11-a739-d1c998650bc7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:19.329531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-11b64907-8c2c-4b11-a739-d1c998650bc7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:19.443267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-11b64907-8c2c-4b11-a739-d1c998650bc7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:19.451896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-11b64907-8c2c-4b11-a739-d1c998650bc7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1222 microversion: 2.1 time: 0.135538 Nov 08 17:40:19.452784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 171/322] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:19 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:19.458030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-24069d75-5924-47c1-9e6b-d058f90fc396 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:19.460443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-24069d75-5924-47c1-9e6b-d058f90fc396 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:19.490057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-24069d75-5924-47c1-9e6b-d058f90fc396 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.491315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-24069d75-5924-47c1-9e6b-d058f90fc396 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.504229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-24069d75-5924-47c1-9e6b-d058f90fc396 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.504897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-24069d75-5924-47c1-9e6b-d058f90fc396 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.505959 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-888c100b-a1f9-4df2-a490-85cc33e3a4e7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:19.531276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-888c100b-a1f9-4df2-a490-85cc33e3a4e7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.271119 Nov 08 17:40:19.533804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 152/323] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:19 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:19.694709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-24069d75-5924-47c1-9e6b-d058f90fc396 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:19.703417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-24069d75-5924-47c1-9e6b-d058f90fc396 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1465 microversion: 2.1 time: 0.249488 Nov 08 17:40:19.703998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 172/324] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:19 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1465 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:19.743306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2720dae7-79fd-42c0-9a82-e4c519ec648a tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:19.744076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2720dae7-79fd-42c0-9a82-e4c519ec648a tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:19.751462 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2720dae7-79fd-42c0-9a82-e4c519ec648a tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.751894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2720dae7-79fd-42c0-9a82-e4c519ec648a tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.752676 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2720dae7-79fd-42c0-9a82-e4c519ec648a tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:19.753232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2720dae7-79fd-42c0-9a82-e4c519ec648a tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:19.784162 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2720dae7-79fd-42c0-9a82-e4c519ec648a tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Going to try to terminate instance {{(pid=127763) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:40:20.048187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d83a725e-5f0e-4fac-8cbf-700b69508dea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:20.048187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d83a725e-5f0e-4fac-8cbf-700b69508dea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:20.050481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d83a725e-5f0e-4fac-8cbf-700b69508dea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.050987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d83a725e-5f0e-4fac-8cbf-700b69508dea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.051787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d83a725e-5f0e-4fac-8cbf-700b69508dea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.052223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d83a725e-5f0e-4fac-8cbf-700b69508dea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.165654 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2720dae7-79fd-42c0-9a82-e4c519ec648a tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 204 len: 0 microversion: 2.1 time: 0.424016 Nov 08 17:40:20.171223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 153/325] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:40:19 2021] DELETE /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:40:20.177307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6d01a67c-4e8e-45b3-a823-c71f63aede73 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:20.177999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6d01a67c-4e8e-45b3-a823-c71f63aede73 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:20.190660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d01a67c-4e8e-45b3-a823-c71f63aede73 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.198272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d01a67c-4e8e-45b3-a823-c71f63aede73 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.199685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d01a67c-4e8e-45b3-a823-c71f63aede73 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.207281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d01a67c-4e8e-45b3-a823-c71f63aede73 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.363520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d83a725e-5f0e-4fac-8cbf-700b69508dea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:20.391333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d83a725e-5f0e-4fac-8cbf-700b69508dea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1503 microversion: 2.1 time: 0.357602 Nov 08 17:40:20.393818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 173/326] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:20 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:20.408993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c2ed0535-f09e-4860-a168-7955c58e7f12 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:20.411200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c2ed0535-f09e-4860-a168-7955c58e7f12 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:20.457142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2ed0535-f09e-4860-a168-7955c58e7f12 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.459461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2ed0535-f09e-4860-a168-7955c58e7f12 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.465947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2ed0535-f09e-4860-a168-7955c58e7f12 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.467451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2ed0535-f09e-4860-a168-7955c58e7f12 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.481908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6d01a67c-4e8e-45b3-a823-c71f63aede73 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:20.494398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6d01a67c-4e8e-45b3-a823-c71f63aede73 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1471 microversion: 2.1 time: 0.321094 Nov 08 17:40:20.496263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 154/327] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:20 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:20.524431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6153d0d2-aa8d-48a1-a32e-7c3c68bed72e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:20.525700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6153d0d2-aa8d-48a1-a32e-7c3c68bed72e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:20.542024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6153d0d2-aa8d-48a1-a32e-7c3c68bed72e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.542736 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6153d0d2-aa8d-48a1-a32e-7c3c68bed72e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.544088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6153d0d2-aa8d-48a1-a32e-7c3c68bed72e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.544746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6153d0d2-aa8d-48a1-a32e-7c3c68bed72e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.626790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c2ed0535-f09e-4860-a168-7955c58e7f12 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 33317 microversion: 2.1 time: 0.228724 Nov 08 17:40:20.630758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 174/328] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:20 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 33317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:20.635349 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-02f2f807-3d4d-4ff8-8ca6-7a61dd1fe520 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:20.636330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-02f2f807-3d4d-4ff8-8ca6-7a61dd1fe520 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:20.642936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02f2f807-3d4d-4ff8-8ca6-7a61dd1fe520 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.643646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02f2f807-3d4d-4ff8-8ca6-7a61dd1fe520 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.644740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02f2f807-3d4d-4ff8-8ca6-7a61dd1fe520 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.645414 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02f2f807-3d4d-4ff8-8ca6-7a61dd1fe520 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.695852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6153d0d2-aa8d-48a1-a32e-7c3c68bed72e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 31829 microversion: 2.20 time: 0.198092 Nov 08 17:40:20.696502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 155/329] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:20 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 31829 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:20.702062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-82f6af14-996e-486d-8393-aaddba8a9c1c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:20.708318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-82f6af14-996e-486d-8393-aaddba8a9c1c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:20.719226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-82f6af14-996e-486d-8393-aaddba8a9c1c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.719226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-82f6af14-996e-486d-8393-aaddba8a9c1c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.719226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-82f6af14-996e-486d-8393-aaddba8a9c1c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.719226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-82f6af14-996e-486d-8393-aaddba8a9c1c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.721550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-02f2f807-3d4d-4ff8-8ca6-7a61dd1fe520 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:20.730787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-02f2f807-3d4d-4ff8-8ca6-7a61dd1fe520 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1226 microversion: 2.1 time: 0.102382 Nov 08 17:40:20.740496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 175/330] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:20 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:20.740496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-ba6ed48f-fe7f-49d3-aaa7-ee95876290c2 req-162a53a4-6a07-43f0-a821-e2ae10849389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d648d192-99df-4847-aa2b-8e360c43a3f2", "name": "network-vif-deleted", "tag": "0e63b98d-e406-49f7-b96d-9d8927ad368d"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:20.740496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:20.740496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:20.748430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-ba6ed48f-fe7f-49d3-aaa7-ee95876290c2 req-162a53a4-6a07-43f0-a821-e2ae10849389 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.748430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-ba6ed48f-fe7f-49d3-aaa7-ee95876290c2 req-162a53a4-6a07-43f0-a821-e2ae10849389 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.759641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-ba6ed48f-fe7f-49d3-aaa7-ee95876290c2 req-162a53a4-6a07-43f0-a821-e2ae10849389 service nova] Creating event network-vif-deleted:0e63b98d-e406-49f7-b96d-9d8927ad368d for instance d648d192-99df-4847-aa2b-8e360c43a3f2 on hv-cinder-81689 Nov 08 17:40:20.764722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-ba6ed48f-fe7f-49d3-aaa7-ee95876290c2 req-162a53a4-6a07-43f0-a821-e2ae10849389 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032191 Nov 08 17:40:20.765606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 176/331] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:20.778245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-3783d460-778c-48ac-b1b9-9bfc2f9004ca req-af3ef9bb-2e2f-4603-9a1c-942847f7fdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4f5525-8b55-43ab-a990-9d151f90f74a", "name": "network-vif-plugged", "status": "completed", "tag": "be2a67f9-fef7-4f3a-849f-362d77b76ae3"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:20.780413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:20.780413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:20.794494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-3783d460-778c-48ac-b1b9-9bfc2f9004ca req-af3ef9bb-2e2f-4603-9a1c-942847f7fdf4 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:20.795519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-3783d460-778c-48ac-b1b9-9bfc2f9004ca req-af3ef9bb-2e2f-4603-9a1c-942847f7fdf4 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:20.820458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-3783d460-778c-48ac-b1b9-9bfc2f9004ca req-af3ef9bb-2e2f-4603-9a1c-942847f7fdf4 service nova] Creating event network-vif-plugged:be2a67f9-fef7-4f3a-849f-362d77b76ae3 for instance 5f4f5525-8b55-43ab-a990-9d151f90f74a on hv-cinder-81689 Nov 08 17:40:20.826807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-3783d460-778c-48ac-b1b9-9bfc2f9004ca req-af3ef9bb-2e2f-4603-9a1c-942847f7fdf4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059684 Nov 08 17:40:20.827758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 177/332] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:20.960774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-82f6af14-996e-486d-8393-aaddba8a9c1c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:20.972996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-82f6af14-996e-486d-8393-aaddba8a9c1c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.273618 Nov 08 17:40:20.981134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 156/333] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:20 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:21.411497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:21.412333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:21.419815 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.420371 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.421418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.421925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.458129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.458603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.459073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lazy-loading 'fault' on Instance uuid d648d192-99df-4847-aa2b-8e360c43a3f2 {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:40:21.504502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:21.516729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7e98c3b7-3985-45dd-a73d-6c3e4fc56482 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1304 microversion: 2.1 time: 0.105661 Nov 08 17:40:21.516729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 178/334] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:21 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:21.516940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1770fb7b-8731-4713-bb4e-d2d22ea81db7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:21.516940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1770fb7b-8731-4713-bb4e-d2d22ea81db7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:21.524481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1770fb7b-8731-4713-bb4e-d2d22ea81db7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.524856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1770fb7b-8731-4713-bb4e-d2d22ea81db7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.525692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1770fb7b-8731-4713-bb4e-d2d22ea81db7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.526177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1770fb7b-8731-4713-bb4e-d2d22ea81db7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.639691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f679d96c-600f-4be7-960d-06ea903ca061 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:21.640679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f679d96c-600f-4be7-960d-06ea903ca061 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:21.648190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f679d96c-600f-4be7-960d-06ea903ca061 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.648190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f679d96c-600f-4be7-960d-06ea903ca061 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.649895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f679d96c-600f-4be7-960d-06ea903ca061 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.650523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f679d96c-600f-4be7-960d-06ea903ca061 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.660892 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1770fb7b-8731-4713-bb4e-d2d22ea81db7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:21.669513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1770fb7b-8731-4713-bb4e-d2d22ea81db7 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1471 microversion: 2.1 time: 0.159863 Nov 08 17:40:21.670488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 157/335] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:21 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:21.709080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7ea2afb0-2615-46f0-86c1-f9555d6e5de7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:21.711550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7ea2afb0-2615-46f0-86c1-f9555d6e5de7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:21.716149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ea2afb0-2615-46f0-86c1-f9555d6e5de7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.716593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ea2afb0-2615-46f0-86c1-f9555d6e5de7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.717406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ea2afb0-2615-46f0-86c1-f9555d6e5de7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.717858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ea2afb0-2615-46f0-86c1-f9555d6e5de7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.766730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f679d96c-600f-4be7-960d-06ea903ca061 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 33683 microversion: 2.1 time: 0.130548 Nov 08 17:40:21.767487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 179/336] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:21 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 33683 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:21.773704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e504e241-5d44-42ec-940f-5c3ca3520020 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:21.780680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e504e241-5d44-42ec-940f-5c3ca3520020 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:21.781312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e504e241-5d44-42ec-940f-5c3ca3520020 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.781759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e504e241-5d44-42ec-940f-5c3ca3520020 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.782562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e504e241-5d44-42ec-940f-5c3ca3520020 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:21.783033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e504e241-5d44-42ec-940f-5c3ca3520020 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:21.845215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e504e241-5d44-42ec-940f-5c3ca3520020 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:21.853090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7ea2afb0-2615-46f0-86c1-f9555d6e5de7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 32798 microversion: 2.20 time: 0.148174 Nov 08 17:40:21.853872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 158/337] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:21 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 32798 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:21.854602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e504e241-5d44-42ec-940f-5c3ca3520020 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1274 microversion: 2.1 time: 0.085887 Nov 08 17:40:21.855251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 180/338] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:21 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:22.015528 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f8ea30a6-db4e-4807-9e7d-af8e5210af49 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:22.015764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f8ea30a6-db4e-4807-9e7d-af8e5210af49 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:22.027173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8ea30a6-db4e-4807-9e7d-af8e5210af49 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.028003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8ea30a6-db4e-4807-9e7d-af8e5210af49 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.029708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8ea30a6-db4e-4807-9e7d-af8e5210af49 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.031485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8ea30a6-db4e-4807-9e7d-af8e5210af49 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.180443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f8ea30a6-db4e-4807-9e7d-af8e5210af49 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:22.187661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f8ea30a6-db4e-4807-9e7d-af8e5210af49 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.187876 Nov 08 17:40:22.188227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 159/339] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:21 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:22.529889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:22.530615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:22.539021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.539772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.540830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.541467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.585347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.585886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.586410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lazy-loading 'fault' on Instance uuid d648d192-99df-4847-aa2b-8e360c43a3f2 {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:40:22.631830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:22.640921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fd50a9fc-aedd-4000-84b5-cc5beb50e5ae tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 200 len: 1304 microversion: 2.1 time: 0.114427 Nov 08 17:40:22.641881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 181/340] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:22 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:22.689639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-761e12a4-5dde-4c40-adde-738568f329c5 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:22.690915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-761e12a4-5dde-4c40-adde-738568f329c5 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:22.701043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-761e12a4-5dde-4c40-adde-738568f329c5 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.701496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-761e12a4-5dde-4c40-adde-738568f329c5 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.703746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-761e12a4-5dde-4c40-adde-738568f329c5 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.704430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-761e12a4-5dde-4c40-adde-738568f329c5 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.784148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f22abff1-3700-43bf-84e1-30527a0aac7b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:22.784148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f22abff1-3700-43bf-84e1-30527a0aac7b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:22.794979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f22abff1-3700-43bf-84e1-30527a0aac7b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.796499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f22abff1-3700-43bf-84e1-30527a0aac7b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.801386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f22abff1-3700-43bf-84e1-30527a0aac7b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:22.802323 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f22abff1-3700-43bf-84e1-30527a0aac7b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:22.941849 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f22abff1-3700-43bf-84e1-30527a0aac7b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 34057 microversion: 2.1 time: 0.164696 Nov 08 17:40:22.944877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 182/341] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:22 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 34057 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:22.969880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-92bfa68d-6a21-4065-a302-89f5189615c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:22.971611 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-92bfa68d-6a21-4065-a302-89f5189615c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:22.979785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-761e12a4-5dde-4c40-adde-738568f329c5 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:22.987241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-761e12a4-5dde-4c40-adde-738568f329c5 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1471 microversion: 2.1 time: 0.303526 Nov 08 17:40:22.987838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 160/342] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:22 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:22.996916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f6071df5-c623-4edf-93b8-66ddcb790747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:22.997799 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f6071df5-c623-4edf-93b8-66ddcb790747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:23.012098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-92bfa68d-6a21-4065-a302-89f5189615c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.018201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-92bfa68d-6a21-4065-a302-89f5189615c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.018345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f6071df5-c623-4edf-93b8-66ddcb790747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.018345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f6071df5-c623-4edf-93b8-66ddcb790747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.018345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f6071df5-c623-4edf-93b8-66ddcb790747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.018345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f6071df5-c623-4edf-93b8-66ddcb790747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.018799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-92bfa68d-6a21-4065-a302-89f5189615c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.018799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-92bfa68d-6a21-4065-a302-89f5189615c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.128178 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f6071df5-c623-4edf-93b8-66ddcb790747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:23.135394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f6071df5-c623-4edf-93b8-66ddcb790747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1280 microversion: 2.1 time: 0.142248 Nov 08 17:40:23.136604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 161/343] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:22 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:23.141395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-92bfa68d-6a21-4065-a302-89f5189615c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 33515 microversion: 2.20 time: 0.193878 Nov 08 17:40:23.143414 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 183/344] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:22 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 33515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:23.209391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-66996e43-f6de-4be7-beb1-50b160f2214f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:23.223623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-66996e43-f6de-4be7-beb1-50b160f2214f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:23.244759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-66996e43-f6de-4be7-beb1-50b160f2214f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.245381 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-66996e43-f6de-4be7-beb1-50b160f2214f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.247057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-66996e43-f6de-4be7-beb1-50b160f2214f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.247644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-66996e43-f6de-4be7-beb1-50b160f2214f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.436284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-f2496edd-17b1-48da-a16b-3cef8c60fac4 req-9fa2bd93-472a-43c3-ac3a-a0559265d048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76806517-5f8b-4d47-89f6-66e876baa194", "tag": "cbf8986a-13eb-4518-a955-17c318486219"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:23.437767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:23.437767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:23.445989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-f2496edd-17b1-48da-a16b-3cef8c60fac4 req-9fa2bd93-472a-43c3-ac3a-a0559265d048 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.446424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-f2496edd-17b1-48da-a16b-3cef8c60fac4 req-9fa2bd93-472a-43c3-ac3a-a0559265d048 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.449259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-66996e43-f6de-4be7-beb1-50b160f2214f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:23.458325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-f2496edd-17b1-48da-a16b-3cef8c60fac4 req-9fa2bd93-472a-43c3-ac3a-a0559265d048 service nova] Creating event network-changed:cbf8986a-13eb-4518-a955-17c318486219 for instance 76806517-5f8b-4d47-89f6-66e876baa194 on hv-cinder-81689 Nov 08 17:40:23.463014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-f2496edd-17b1-48da-a16b-3cef8c60fac4 req-9fa2bd93-472a-43c3-ac3a-a0559265d048 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030661 Nov 08 17:40:23.463729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 184/345] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:40:23.467882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-66996e43-f6de-4be7-beb1-50b160f2214f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1317 microversion: 2.1 time: 0.265996 Nov 08 17:40:23.468967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 162/346] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:23 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:23.618998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-7714e15f-b811-4fbe-b427-da0f024a1329 req-c14e1c8b-b001-41b9-be9b-422d0aed6f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23440014-4f2c-41f4-ae48-24c2c9ea50da", "name": "network-vif-deleted", "tag": "1e45840d-466e-4a14-8434-90b94be70955"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:23.620468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:23.620468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:23.627959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-7714e15f-b811-4fbe-b427-da0f024a1329 req-c14e1c8b-b001-41b9-be9b-422d0aed6f5e service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.628493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-7714e15f-b811-4fbe-b427-da0f024a1329 req-c14e1c8b-b001-41b9-be9b-422d0aed6f5e service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.641745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-7714e15f-b811-4fbe-b427-da0f024a1329 req-c14e1c8b-b001-41b9-be9b-422d0aed6f5e service nova] Creating event network-vif-deleted:1e45840d-466e-4a14-8434-90b94be70955 for instance 23440014-4f2c-41f4-ae48-24c2c9ea50da on hv-cinder-81689 Nov 08 17:40:23.648499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-7714e15f-b811-4fbe-b427-da0f024a1329 req-c14e1c8b-b001-41b9-be9b-422d0aed6f5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Nov 08 17:40:23.649142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 185/347] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:23.659463 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:23.660910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: d648d192-99df-4847-aa2b-8e360c43a3f2] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:23.671236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.671771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.672563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.672995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.703218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] HTTP exception thrown: Instance d648d192-99df-4847-aa2b-8e360c43a3f2 could not be found. Nov 08 17:40:23.703218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Returning 404 to user: Instance d648d192-99df-4847-aa2b-8e360c43a3f2 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:23.703218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a3f47fce-7646-40f6-bd41-5568ac2fb50e tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2" status: 404 len: 111 microversion: 2.1 time: 0.033414 Nov 08 17:40:23.703218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 163/348] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:23 2021] GET /compute/v2.1/servers/d648d192-99df-4847-aa2b-8e360c43a3f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:40:23.793245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-253096037", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "networks": [{"uuid": "d915a2e0-6f4f-40e6-bfd6-8506152b8092"}]}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:23.845941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.network.neutron [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] validate_networks() for [('d915a2e0-6f4f-40e6-bfd6-8506152b8092', None, None, None, None, None)] {{(pid=127762) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:40:23.954381 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d00a234c-86d8-4272-918f-efdd235e1e72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:23.955323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d00a234c-86d8-4272-918f-efdd235e1e72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:23.962653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d00a234c-86d8-4272-918f-efdd235e1e72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.963112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d00a234c-86d8-4272-918f-efdd235e1e72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:23.963897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d00a234c-86d8-4272-918f-efdd235e1e72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:23.964336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d00a234c-86d8-4272-918f-efdd235e1e72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:24.177560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Flavor limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:40:24.177977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Image limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:40:24.178443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Flavor pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:40:24.178872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Image pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:40:24.179272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:40:24.187756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:24.188199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:24.189001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:24.189433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:24.205079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Getting quotas for project 617b49281015470ba0eb03102015c072. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:40:24.209430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Getting quotas for user 2cc50d8aef6145358cf9563338a5321c and project 617b49281015470ba0eb03102015c072. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:40:24.219884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Going to run 1 instances... {{(pid=127762) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:40:24.222769 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:40:24.382895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fc5215a0-0e7e-4fcb-9c6d-033eba0bb235 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593886 Nov 08 17:40:24.384219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 186/349] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:40:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:40:24.389145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0b03c08b-a900-4d71-aad7-cb0d96063139 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:24.389813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0b03c08b-a900-4d71-aad7-cb0d96063139 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:24.396992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b03c08b-a900-4d71-aad7-cb0d96063139 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:24.397445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b03c08b-a900-4d71-aad7-cb0d96063139 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:24.398233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b03c08b-a900-4d71-aad7-cb0d96063139 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:24.398712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b03c08b-a900-4d71-aad7-cb0d96063139 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:24.504195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0b03c08b-a900-4d71-aad7-cb0d96063139 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:24.504195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0b03c08b-a900-4d71-aad7-cb0d96063139 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1429 microversion: 2.1 time: 0.116339 Nov 08 17:40:24.504195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 187/350] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:24 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:24.514180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f098b74c-6fd4-4f16-bea7-f4983a5898af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:24.514180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f098b74c-6fd4-4f16-bea7-f4983a5898af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:24.514871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f098b74c-6fd4-4f16-bea7-f4983a5898af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:24.515322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f098b74c-6fd4-4f16-bea7-f4983a5898af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:24.516111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f098b74c-6fd4-4f16-bea7-f4983a5898af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:24.516545 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f098b74c-6fd4-4f16-bea7-f4983a5898af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:24.652932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f098b74c-6fd4-4f16-bea7-f4983a5898af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:24.660802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f098b74c-6fd4-4f16-bea7-f4983a5898af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1322 microversion: 2.1 time: 0.157331 Nov 08 17:40:24.661353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 188/351] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:24 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:24.665690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-973f1b82-1e01-42a7-9185-5907514a0276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:24.666662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-973f1b82-1e01-42a7-9185-5907514a0276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:24.672409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-973f1b82-1e01-42a7-9185-5907514a0276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:24.672846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-973f1b82-1e01-42a7-9185-5907514a0276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:24.673787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-973f1b82-1e01-42a7-9185-5907514a0276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:24.674217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-973f1b82-1e01-42a7-9185-5907514a0276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:26.461709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-973f1b82-1e01-42a7-9185-5907514a0276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 35908 microversion: 2.20 time: 1.799119 Nov 08 17:40:26.463101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 189/352] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:24 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 35908 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:26.471043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9a802e86-25b1-41ef-911c-490b35a2eccb tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:26.471955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9a802e86-25b1-41ef-911c-490b35a2eccb tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:26.479409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a802e86-25b1-41ef-911c-490b35a2eccb tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:26.480713 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a802e86-25b1-41ef-911c-490b35a2eccb tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:26.481005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a802e86-25b1-41ef-911c-490b35a2eccb tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:26.481249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9a802e86-25b1-41ef-911c-490b35a2eccb tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:26.488827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d00a234c-86d8-4272-918f-efdd235e1e72 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 35743 microversion: 2.1 time: 2.537247 Nov 08 17:40:26.488827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 164/353] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:23 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 35743 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:40:26.494335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e714ab1e-6dfc-47a3-8ff3-d7769c801c3b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:26.495162 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e714ab1e-6dfc-47a3-8ff3-d7769c801c3b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:26.502448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e714ab1e-6dfc-47a3-8ff3-d7769c801c3b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:26.503086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e714ab1e-6dfc-47a3-8ff3-d7769c801c3b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:26.503999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e714ab1e-6dfc-47a3-8ff3-d7769c801c3b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:26.504598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e714ab1e-6dfc-47a3-8ff3-d7769c801c3b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:26.580155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9a802e86-25b1-41ef-911c-490b35a2eccb tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:26.588677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9a802e86-25b1-41ef-911c-490b35a2eccb tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1217 microversion: 2.1 time: 0.124263 Nov 08 17:40:26.589305 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 190/354] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:26 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:26.606166 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5934ee5a-3546-42a1-97e4-652989792159 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:26.620569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5934ee5a-3546-42a1-97e4-652989792159 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:26.620569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5934ee5a-3546-42a1-97e4-652989792159 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:26.620569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5934ee5a-3546-42a1-97e4-652989792159 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:26.620569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5934ee5a-3546-42a1-97e4-652989792159 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:26.620986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5934ee5a-3546-42a1-97e4-652989792159 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:26.723980 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5934ee5a-3546-42a1-97e4-652989792159 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aaea1e512ce47bda322c0abbf20db95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e75ece2b2c7421b827f4bce8c2fa189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:26.732152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5934ee5a-3546-42a1-97e4-652989792159 tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 200 len: 1300 microversion: 2.1 time: 0.132003 Nov 08 17:40:26.743195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 191/355] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:26 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:26.763904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-84fbfdc6-3202-4252-a2bd-8a5add1d09af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:26.766204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-84fbfdc6-3202-4252-a2bd-8a5add1d09af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:26.774937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84fbfdc6-3202-4252-a2bd-8a5add1d09af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:26.775381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84fbfdc6-3202-4252-a2bd-8a5add1d09af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:26.776163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84fbfdc6-3202-4252-a2bd-8a5add1d09af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:26.776596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84fbfdc6-3202-4252-a2bd-8a5add1d09af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.136978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e714ab1e-6dfc-47a3-8ff3-d7769c801c3b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:27.145033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e714ab1e-6dfc-47a3-8ff3-d7769c801c3b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1508 microversion: 2.1 time: 0.654590 Nov 08 17:40:27.146379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 165/356] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:26 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1508 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:27.215584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-26ede23b-ce89-4a31-825e-63cd4601eea4 req-a23a676f-afc1-4c2f-9afa-4a0b9f9d70c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ac9249-632c-47a0-9e4d-c755389099b6", "tag": "11f15d53-0cdb-4385-a9ee-9c72b5c78f2a"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:27.227780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:27.227780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:40:27.256243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-26ede23b-ce89-4a31-825e-63cd4601eea4 req-a23a676f-afc1-4c2f-9afa-4a0b9f9d70c8 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.256720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-26ede23b-ce89-4a31-825e-63cd4601eea4 req-a23a676f-afc1-4c2f-9afa-4a0b9f9d70c8 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.270320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-26ede23b-ce89-4a31-825e-63cd4601eea4 req-a23a676f-afc1-4c2f-9afa-4a0b9f9d70c8 service nova] Creating event network-changed:11f15d53-0cdb-4385-a9ee-9c72b5c78f2a for instance a5ac9249-632c-47a0-9e4d-c755389099b6 on hv-cinder-81689 Nov 08 17:40:27.275793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-26ede23b-ce89-4a31-825e-63cd4601eea4 req-a23a676f-afc1-4c2f-9afa-4a0b9f9d70c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064899 Nov 08 17:40:27.276410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 166/357] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:27.278515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-84fbfdc6-3202-4252-a2bd-8a5add1d09af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:27.286357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-84fbfdc6-3202-4252-a2bd-8a5add1d09af tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1322 microversion: 2.1 time: 0.529913 Nov 08 17:40:27.290033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 192/358] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:26 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:27.477381 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e8ccc684-7750-4297-b272-a63592895b6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:27.479231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e8ccc684-7750-4297-b272-a63592895b6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:27.493583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e8ccc684-7750-4297-b272-a63592895b6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.494787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e8ccc684-7750-4297-b272-a63592895b6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.495803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e8ccc684-7750-4297-b272-a63592895b6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.496397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e8ccc684-7750-4297-b272-a63592895b6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.500154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-155935da-ee9b-492a-af3f-a4185d5274a6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:27.501148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-155935da-ee9b-492a-af3f-a4185d5274a6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:27.516053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-155935da-ee9b-492a-af3f-a4185d5274a6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.516053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-155935da-ee9b-492a-af3f-a4185d5274a6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.516053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-155935da-ee9b-492a-af3f-a4185d5274a6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.516053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-155935da-ee9b-492a-af3f-a4185d5274a6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.635291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e8ccc684-7750-4297-b272-a63592895b6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 36517 microversion: 2.20 time: 0.164245 Nov 08 17:40:27.635957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 167/359] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:27 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 36517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:27.643417 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-869dedaf-90fa-4b4b-8539-6d3e4cf7f808 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:27.645694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-869dedaf-90fa-4b4b-8539-6d3e4cf7f808 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:27.654492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-869dedaf-90fa-4b4b-8539-6d3e4cf7f808 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.655171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-869dedaf-90fa-4b4b-8539-6d3e4cf7f808 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.655962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-869dedaf-90fa-4b4b-8539-6d3e4cf7f808 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.656389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-869dedaf-90fa-4b4b-8539-6d3e4cf7f808 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.665334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-155935da-ee9b-492a-af3f-a4185d5274a6 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 36629 microversion: 2.1 time: 0.168415 Nov 08 17:40:27.666125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 193/360] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:27 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 36629 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:27.753178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:27.758798 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] [instance: 23440014-4f2c-41f4-ae48-24c2c9ea50da] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:27.763307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-869dedaf-90fa-4b4b-8539-6d3e4cf7f808 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:27.776606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.781377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-869dedaf-90fa-4b4b-8539-6d3e4cf7f808 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1265 microversion: 2.1 time: 0.144226 Nov 08 17:40:27.782243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 168/361] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:27 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:27.794912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.795968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:27.796426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:27.824686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] HTTP exception thrown: Instance 23440014-4f2c-41f4-ae48-24c2c9ea50da could not be found. Nov 08 17:40:27.829160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] Returning 404 to user: Instance 23440014-4f2c-41f4-ae48-24c2c9ea50da could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:27.829160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-93d422f4-100b-46d1-beea-8cf8b7fe873c tempest-VolumesNegativeTest-951145603 tempest-VolumesNegativeTest-951145603-project] 10.222.0.18 "GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da" status: 404 len: 111 microversion: 2.1 time: 0.077244 Nov 08 17:40:27.829160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 194/362] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:27 2021] GET /compute/v2.1/servers/23440014-4f2c-41f4-ae48-24c2c9ea50da => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 17:40:28.303661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d946ef73-c55f-4263-b2b5-bf5bca9ab514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:28.304276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d946ef73-c55f-4263-b2b5-bf5bca9ab514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:28.315685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d946ef73-c55f-4263-b2b5-bf5bca9ab514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.316762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d946ef73-c55f-4263-b2b5-bf5bca9ab514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.318219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d946ef73-c55f-4263-b2b5-bf5bca9ab514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.319613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d946ef73-c55f-4263-b2b5-bf5bca9ab514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.480226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d946ef73-c55f-4263-b2b5-bf5bca9ab514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:28.492230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d946ef73-c55f-4263-b2b5-bf5bca9ab514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1322 microversion: 2.1 time: 0.192770 Nov 08 17:40:28.502041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 169/363] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:28 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:28.647005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2c53e898-7473-44e1-8540-9f2cb8facd02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:28.647917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2c53e898-7473-44e1-8540-9f2cb8facd02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:28.655021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2c53e898-7473-44e1-8540-9f2cb8facd02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.655503 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2c53e898-7473-44e1-8540-9f2cb8facd02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.656310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2c53e898-7473-44e1-8540-9f2cb8facd02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.656748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2c53e898-7473-44e1-8540-9f2cb8facd02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.677501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ab5d0112-02fc-4a3a-b0f4-71e2b729a098 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:28.678482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ab5d0112-02fc-4a3a-b0f4-71e2b729a098 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:28.684202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ab5d0112-02fc-4a3a-b0f4-71e2b729a098 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.684868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ab5d0112-02fc-4a3a-b0f4-71e2b729a098 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.685828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ab5d0112-02fc-4a3a-b0f4-71e2b729a098 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.686259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ab5d0112-02fc-4a3a-b0f4-71e2b729a098 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.752000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2c53e898-7473-44e1-8540-9f2cb8facd02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 37341 microversion: 2.20 time: 0.108519 Nov 08 17:40:28.757672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 195/364] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:28 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 37341 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:28.787721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ab5d0112-02fc-4a3a-b0f4-71e2b729a098 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 37482 microversion: 2.1 time: 0.114213 Nov 08 17:40:28.788698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 170/365] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:28 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 37482 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:40:28.817753 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5edb1788-0fb6-4ef1-976e-93a2eb83ee37 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:28.817753 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5edb1788-0fb6-4ef1-976e-93a2eb83ee37 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:28.824102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5edb1788-0fb6-4ef1-976e-93a2eb83ee37 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.824829 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5edb1788-0fb6-4ef1-976e-93a2eb83ee37 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.825821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5edb1788-0fb6-4ef1-976e-93a2eb83ee37 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.826559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5edb1788-0fb6-4ef1-976e-93a2eb83ee37 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.911553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5edb1788-0fb6-4ef1-976e-93a2eb83ee37 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:28.920261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5edb1788-0fb6-4ef1-976e-93a2eb83ee37 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1283 microversion: 2.1 time: 0.110177 Nov 08 17:40:28.922900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 196/366] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:28 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:28.950798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-970cb232-b50d-4cb4-89d9-b9d02f707605 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12049e74-4fd9-4037-a18e-7ddf37802b44"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:28.952022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-970cb232-b50d-4cb4-89d9-b9d02f707605 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:28.967504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-970cb232-b50d-4cb4-89d9-b9d02f707605 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.971215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-970cb232-b50d-4cb4-89d9-b9d02f707605 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:28.971215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-970cb232-b50d-4cb4-89d9-b9d02f707605 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:28.971215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-970cb232-b50d-4cb4-89d9-b9d02f707605 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:29.510343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-105b8d72-19c6-4134-9d57-e054141342a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:29.510979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-105b8d72-19c6-4134-9d57-e054141342a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:29.517255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-105b8d72-19c6-4134-9d57-e054141342a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:29.517701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-105b8d72-19c6-4134-9d57-e054141342a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:29.518507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-105b8d72-19c6-4134-9d57-e054141342a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:29.519961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-105b8d72-19c6-4134-9d57-e054141342a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:29.662493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-105b8d72-19c6-4134-9d57-e054141342a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:29.671797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-105b8d72-19c6-4134-9d57-e054141342a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1322 microversion: 2.1 time: 0.166152 Nov 08 17:40:29.672361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 197/367] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:29 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:29.765432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-46a6595f-58ad-42fc-a069-528ee493a672 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:29.766411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-46a6595f-58ad-42fc-a069-528ee493a672 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:29.772556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46a6595f-58ad-42fc-a069-528ee493a672 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:29.772937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46a6595f-58ad-42fc-a069-528ee493a672 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:29.773694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46a6595f-58ad-42fc-a069-528ee493a672 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:29.774121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46a6595f-58ad-42fc-a069-528ee493a672 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:29.864082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-46a6595f-58ad-42fc-a069-528ee493a672 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 38126 microversion: 2.20 time: 0.101340 Nov 08 17:40:29.865427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 198/368] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:29 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 38126 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:29.873921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c57138bf-d27b-4f43-98e9-aacb532065fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:29.873921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c57138bf-d27b-4f43-98e9-aacb532065fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:29.874113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-970cb232-b50d-4cb4-89d9-b9d02f707605 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926578 Nov 08 17:40:29.884816 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 171/369] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:40:28 2021] POST /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:29.903137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c57138bf-d27b-4f43-98e9-aacb532065fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:29.903279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c57138bf-d27b-4f43-98e9-aacb532065fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:29.907914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c57138bf-d27b-4f43-98e9-aacb532065fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:29.908772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c57138bf-d27b-4f43-98e9-aacb532065fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:29.944509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-279a4c00-b1d8-4a5f-b912-f99b590a163b tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:29.945207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-279a4c00-b1d8-4a5f-b912-f99b590a163b tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:29.961443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-279a4c00-b1d8-4a5f-b912-f99b590a163b tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:29.961443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-279a4c00-b1d8-4a5f-b912-f99b590a163b tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:29.961443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-279a4c00-b1d8-4a5f-b912-f99b590a163b tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:29.961443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-279a4c00-b1d8-4a5f-b912-f99b590a163b tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:30.045701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c57138bf-d27b-4f43-98e9-aacb532065fb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 38092 microversion: 2.1 time: 0.178585 Nov 08 17:40:30.046715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 199/370] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:29 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 38092 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:30.139923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-279a4c00-b1d8-4a5f-b912-f99b590a163b tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:30.147243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-279a4c00-b1d8-4a5f-b912-f99b590a163b tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.207393 Nov 08 17:40:30.147804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 172/371] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:29 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:30.317422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-d4f5b84f-0b07-4dad-9ff0-f6d31e0a0c95 req-deed164b-8819-41e5-8d3f-cdc8bc0f4216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3fb24d-d18a-48b3-9a3b-f432e1161786", "tag": "5f72aca0-6c46-4408-9132-c29029a06432"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:30.320081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:30.320081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:30.334863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-d4f5b84f-0b07-4dad-9ff0-f6d31e0a0c95 req-deed164b-8819-41e5-8d3f-cdc8bc0f4216 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:30.335365 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-d4f5b84f-0b07-4dad-9ff0-f6d31e0a0c95 req-deed164b-8819-41e5-8d3f-cdc8bc0f4216 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:30.348358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-d4f5b84f-0b07-4dad-9ff0-f6d31e0a0c95 req-deed164b-8819-41e5-8d3f-cdc8bc0f4216 service nova] Creating event network-changed:5f72aca0-6c46-4408-9132-c29029a06432 for instance 3b3fb24d-d18a-48b3-9a3b-f432e1161786 on hv-cinder-81689 Nov 08 17:40:30.354050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-d4f5b84f-0b07-4dad-9ff0-f6d31e0a0c95 req-deed164b-8819-41e5-8d3f-cdc8bc0f4216 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043236 Nov 08 17:40:30.354957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 200/372] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:30.690402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1c49e5d2-5428-46f1-9039-cb76a5700428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:30.691081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1c49e5d2-5428-46f1-9039-cb76a5700428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:30.698329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1c49e5d2-5428-46f1-9039-cb76a5700428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:30.699219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1c49e5d2-5428-46f1-9039-cb76a5700428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:30.700172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1c49e5d2-5428-46f1-9039-cb76a5700428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:30.700761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1c49e5d2-5428-46f1-9039-cb76a5700428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:30.879494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2eef1b48-b6d9-450b-98d6-914747cb9228 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:30.881188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2eef1b48-b6d9-450b-98d6-914747cb9228 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:30.881898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1c49e5d2-5428-46f1-9039-cb76a5700428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:30.889681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1c49e5d2-5428-46f1-9039-cb76a5700428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1322 microversion: 2.1 time: 0.204652 Nov 08 17:40:30.890600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 173/373] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:30 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:30.899296 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2eef1b48-b6d9-450b-98d6-914747cb9228 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:30.900034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2eef1b48-b6d9-450b-98d6-914747cb9228 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:30.901021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2eef1b48-b6d9-450b-98d6-914747cb9228 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:30.901677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2eef1b48-b6d9-450b-98d6-914747cb9228 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:30.980253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2eef1b48-b6d9-450b-98d6-914747cb9228 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 38126 microversion: 2.20 time: 0.107014 Nov 08 17:40:30.981427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 201/374] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:30 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 38126 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:31.059151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4ea9d501-3822-41df-b86b-73b12ae5bd11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:31.060778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4ea9d501-3822-41df-b86b-73b12ae5bd11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:31.069653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ea9d501-3822-41df-b86b-73b12ae5bd11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:31.070229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ea9d501-3822-41df-b86b-73b12ae5bd11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:31.071322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ea9d501-3822-41df-b86b-73b12ae5bd11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:31.072003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ea9d501-3822-41df-b86b-73b12ae5bd11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:31.148512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4ea9d501-3822-41df-b86b-73b12ae5bd11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 38092 microversion: 2.1 time: 0.094269 Nov 08 17:40:31.149298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 174/375] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:31 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 38092 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:31.165200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5330922d-d8ae-4f86-b971-38d8f1bf54ea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:31.166162 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5330922d-d8ae-4f86-b971-38d8f1bf54ea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:31.174187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5330922d-d8ae-4f86-b971-38d8f1bf54ea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:31.174684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5330922d-d8ae-4f86-b971-38d8f1bf54ea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:31.176202 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5330922d-d8ae-4f86-b971-38d8f1bf54ea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:31.176796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5330922d-d8ae-4f86-b971-38d8f1bf54ea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:31.320851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5330922d-d8ae-4f86-b971-38d8f1bf54ea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:31.328625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5330922d-d8ae-4f86-b971-38d8f1bf54ea tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.167493 Nov 08 17:40:31.338520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 202/376] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:31 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:31.907774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1508f676-eb24-4479-8af3-92d0494cbae0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:31.908462 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1508f676-eb24-4479-8af3-92d0494cbae0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:31.916540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1508f676-eb24-4479-8af3-92d0494cbae0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:31.922526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1508f676-eb24-4479-8af3-92d0494cbae0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:31.922526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1508f676-eb24-4479-8af3-92d0494cbae0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:31.922526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1508f676-eb24-4479-8af3-92d0494cbae0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:31.994232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c076076e-9278-499a-bdf1-783ca7901d1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:31.996450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c076076e-9278-499a-bdf1-783ca7901d1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:32.007666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c076076e-9278-499a-bdf1-783ca7901d1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:32.008355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c076076e-9278-499a-bdf1-783ca7901d1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:32.009389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c076076e-9278-499a-bdf1-783ca7901d1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:32.009822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c076076e-9278-499a-bdf1-783ca7901d1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:32.068606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1508f676-eb24-4479-8af3-92d0494cbae0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:32.076549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1508f676-eb24-4479-8af3-92d0494cbae0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1322 microversion: 2.1 time: 0.173759 Nov 08 17:40:32.077129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 175/377] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:31 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:32.100112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c076076e-9278-499a-bdf1-783ca7901d1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 38126 microversion: 2.20 time: 0.112002 Nov 08 17:40:32.101330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 203/378] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:31 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 38126 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:40:32.160137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-acaea17b-adc4-4757-9f9a-c9243bc39654 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:32.161191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-acaea17b-adc4-4757-9f9a-c9243bc39654 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:32.167981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-acaea17b-adc4-4757-9f9a-c9243bc39654 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:32.168499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-acaea17b-adc4-4757-9f9a-c9243bc39654 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:32.169356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-acaea17b-adc4-4757-9f9a-c9243bc39654 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:32.169824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-acaea17b-adc4-4757-9f9a-c9243bc39654 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:32.236225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-acaea17b-adc4-4757-9f9a-c9243bc39654 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 38092 microversion: 2.1 time: 0.080156 Nov 08 17:40:32.240413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 176/379] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:32 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 38092 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:32.350320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-71f839ad-79ce-4d2c-83b1-584300a8acf8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:32.351291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-71f839ad-79ce-4d2c-83b1-584300a8acf8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:32.359858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71f839ad-79ce-4d2c-83b1-584300a8acf8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:32.360298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71f839ad-79ce-4d2c-83b1-584300a8acf8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:32.361610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71f839ad-79ce-4d2c-83b1-584300a8acf8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:32.362129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71f839ad-79ce-4d2c-83b1-584300a8acf8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:32.498514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-71f839ad-79ce-4d2c-83b1-584300a8acf8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:32.506395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-71f839ad-79ce-4d2c-83b1-584300a8acf8 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.164208 Nov 08 17:40:32.507008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 204/380] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:32 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:32.673842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-94d9ca42-3834-4856-a58d-fb60ce57ddc7 req-fa7c96fe-3b58-458d-b651-b3e868fb6683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ac9249-632c-47a0-9e4d-c755389099b6", "name": "network-vif-plugged", "status": "completed", "tag": "11f15d53-0cdb-4385-a9ee-9c72b5c78f2a"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:32.676491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:32.676491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:40:32.684514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-94d9ca42-3834-4856-a58d-fb60ce57ddc7 req-fa7c96fe-3b58-458d-b651-b3e868fb6683 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:32.685084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-94d9ca42-3834-4856-a58d-fb60ce57ddc7 req-fa7c96fe-3b58-458d-b651-b3e868fb6683 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:32.697059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-94d9ca42-3834-4856-a58d-fb60ce57ddc7 req-fa7c96fe-3b58-458d-b651-b3e868fb6683 service nova] Creating event network-vif-plugged:11f15d53-0cdb-4385-a9ee-9c72b5c78f2a for instance a5ac9249-632c-47a0-9e4d-c755389099b6 on hv-cinder-81689 Nov 08 17:40:32.701723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-94d9ca42-3834-4856-a58d-fb60ce57ddc7 req-fa7c96fe-3b58-458d-b651-b3e868fb6683 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032211 Nov 08 17:40:32.702306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 177/381] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:40:33.093386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-639ab811-b019-4e24-83de-01421d07eed8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:33.094019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-639ab811-b019-4e24-83de-01421d07eed8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:33.104329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-639ab811-b019-4e24-83de-01421d07eed8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.104467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-639ab811-b019-4e24-83de-01421d07eed8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.105903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-639ab811-b019-4e24-83de-01421d07eed8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.106620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-639ab811-b019-4e24-83de-01421d07eed8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.119684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ee373942-aa0a-4121-875a-96494ca61992 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:33.122899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ee373942-aa0a-4121-875a-96494ca61992 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:33.131306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee373942-aa0a-4121-875a-96494ca61992 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.131748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee373942-aa0a-4121-875a-96494ca61992 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.132540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee373942-aa0a-4121-875a-96494ca61992 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.133161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee373942-aa0a-4121-875a-96494ca61992 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.250087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-639ab811-b019-4e24-83de-01421d07eed8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:33.257841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-639ab811-b019-4e24-83de-01421d07eed8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1322 microversion: 2.1 time: 0.168353 Nov 08 17:40:33.258412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 205/382] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:33 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:33.262671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e559df2c-5335-406c-a2b0-0b6723d23ba8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:33.263567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e559df2c-5335-406c-a2b0-0b6723d23ba8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:33.268974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e559df2c-5335-406c-a2b0-0b6723d23ba8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.269627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e559df2c-5335-406c-a2b0-0b6723d23ba8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.270413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e559df2c-5335-406c-a2b0-0b6723d23ba8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.270874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e559df2c-5335-406c-a2b0-0b6723d23ba8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.355952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ee373942-aa0a-4121-875a-96494ca61992 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 38126 microversion: 2.20 time: 0.246370 Nov 08 17:40:33.356612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 178/383] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:33 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 38126 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:33.375739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e559df2c-5335-406c-a2b0-0b6723d23ba8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 200 len: 38221 microversion: 2.1 time: 0.115679 Nov 08 17:40:33.384317 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 206/384] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:33 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 38221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:33.390844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5dd89a2c-60fd-4bc2-b9c3-8e4e86536165 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:33.390844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5dd89a2c-60fd-4bc2-b9c3-8e4e86536165 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:33.399742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dd89a2c-60fd-4bc2-b9c3-8e4e86536165 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.400195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dd89a2c-60fd-4bc2-b9c3-8e4e86536165 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.401103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dd89a2c-60fd-4bc2-b9c3-8e4e86536165 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.401608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dd89a2c-60fd-4bc2-b9c3-8e4e86536165 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.428086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5dd89a2c-60fd-4bc2-b9c3-8e4e86536165 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/ips" status: 200 len: 147 microversion: 2.1 time: 0.042286 Nov 08 17:40:33.428677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 179/385] 10.222.0.18 () {58 vars in 1247 bytes} [Mon Nov 8 17:40:33 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:40:33.523855 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5c85c557-5007-41ca-91e5-d2f9ceeb4067 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:33.524560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5c85c557-5007-41ca-91e5-d2f9ceeb4067 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:33.531643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c85c557-5007-41ca-91e5-d2f9ceeb4067 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.532093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c85c557-5007-41ca-91e5-d2f9ceeb4067 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.532865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c85c557-5007-41ca-91e5-d2f9ceeb4067 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:33.533322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c85c557-5007-41ca-91e5-d2f9ceeb4067 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:33.679014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5c85c557-5007-41ca-91e5-d2f9ceeb4067 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:33.687100 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5c85c557-5007-41ca-91e5-d2f9ceeb4067 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.167934 Nov 08 17:40:33.687763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 207/386] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:33 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:34.275092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-381e3647-bb6b-429a-8d8f-6f62ee564f50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:34.275717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-381e3647-bb6b-429a-8d8f-6f62ee564f50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:34.282253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-381e3647-bb6b-429a-8d8f-6f62ee564f50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.282740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-381e3647-bb6b-429a-8d8f-6f62ee564f50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.283527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-381e3647-bb6b-429a-8d8f-6f62ee564f50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.283965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-381e3647-bb6b-429a-8d8f-6f62ee564f50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.368443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-421b8450-984b-4c43-965a-d5ddf87d5f31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:34.369672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-421b8450-984b-4c43-965a-d5ddf87d5f31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:34.377060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-421b8450-984b-4c43-965a-d5ddf87d5f31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.377357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-421b8450-984b-4c43-965a-d5ddf87d5f31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.379051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-421b8450-984b-4c43-965a-d5ddf87d5f31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.379551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-421b8450-984b-4c43-965a-d5ddf87d5f31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.438807 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-381e3647-bb6b-429a-8d8f-6f62ee564f50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:34.447449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-381e3647-bb6b-429a-8d8f-6f62ee564f50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1322 microversion: 2.1 time: 0.176181 Nov 08 17:40:34.457268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 180/387] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:34 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:34.499203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-421b8450-984b-4c43-965a-d5ddf87d5f31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 38266 microversion: 2.20 time: 0.134495 Nov 08 17:40:34.501922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 208/388] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:34 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 38266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:34.517017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0b43e3e8-c3f2-4a57-af23-368e14b27d2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:34.517507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0b43e3e8-c3f2-4a57-af23-368e14b27d2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:34.525527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b43e3e8-c3f2-4a57-af23-368e14b27d2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.526150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b43e3e8-c3f2-4a57-af23-368e14b27d2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.527125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b43e3e8-c3f2-4a57-af23-368e14b27d2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.527658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b43e3e8-c3f2-4a57-af23-368e14b27d2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.558015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0b43e3e8-c3f2-4a57-af23-368e14b27d2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/ips" status: 200 len: 151 microversion: 2.20 time: 0.044673 Nov 08 17:40:34.558713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 181/389] 10.222.0.18 () {60 vars in 1288 bytes} [Mon Nov 8 17:40:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:40:34.706090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-aca19005-54c2-4b12-b77d-2b59b47feabc tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:34.707902 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-aca19005-54c2-4b12-b77d-2b59b47feabc tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:34.716114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aca19005-54c2-4b12-b77d-2b59b47feabc tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.717794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aca19005-54c2-4b12-b77d-2b59b47feabc tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.718848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aca19005-54c2-4b12-b77d-2b59b47feabc tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.719507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aca19005-54c2-4b12-b77d-2b59b47feabc tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.725354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-6ec91c7f-59d6-484f-88b7-ef29ea52d26e req-a5743b5f-1f70-4418-ab86-9f6828cf876c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76806517-5f8b-4d47-89f6-66e876baa194", "name": "network-vif-plugged", "status": "completed", "tag": "cbf8986a-13eb-4518-a955-17c318486219"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:34.727701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:34.727701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:40:34.741063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-6ec91c7f-59d6-484f-88b7-ef29ea52d26e req-a5743b5f-1f70-4418-ab86-9f6828cf876c service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:34.741545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-6ec91c7f-59d6-484f-88b7-ef29ea52d26e req-a5743b5f-1f70-4418-ab86-9f6828cf876c service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:34.755682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-6ec91c7f-59d6-484f-88b7-ef29ea52d26e req-a5743b5f-1f70-4418-ab86-9f6828cf876c service nova] Creating event network-vif-plugged:cbf8986a-13eb-4518-a955-17c318486219 for instance 76806517-5f8b-4d47-89f6-66e876baa194 on hv-cinder-81689 Nov 08 17:40:34.776208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-6ec91c7f-59d6-484f-88b7-ef29ea52d26e req-a5743b5f-1f70-4418-ab86-9f6828cf876c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051313 Nov 08 17:40:34.779643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 182/390] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:40:34.884801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-aca19005-54c2-4b12-b77d-2b59b47feabc tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:34.892404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-aca19005-54c2-4b12-b77d-2b59b47feabc tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.190764 Nov 08 17:40:34.892964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 209/391] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:34 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:35.471236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4b9aa68a-1878-480f-85de-90681960feb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:35.472606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4b9aa68a-1878-480f-85de-90681960feb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:35.483532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b9aa68a-1878-480f-85de-90681960feb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:35.483532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b9aa68a-1878-480f-85de-90681960feb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:35.483532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b9aa68a-1878-480f-85de-90681960feb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:35.483532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b9aa68a-1878-480f-85de-90681960feb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:35.696507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4b9aa68a-1878-480f-85de-90681960feb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:35.703723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4b9aa68a-1878-480f-85de-90681960feb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1517 microversion: 2.1 time: 0.237228 Nov 08 17:40:35.704702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 183/392] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:35 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:35.722647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0e52ce7d-80fb-423a-b464-8ca58ba92250 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:35.723589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0e52ce7d-80fb-423a-b464-8ca58ba92250 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:35.730484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e52ce7d-80fb-423a-b464-8ca58ba92250 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:35.730983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e52ce7d-80fb-423a-b464-8ca58ba92250 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:35.731809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e52ce7d-80fb-423a-b464-8ca58ba92250 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:35.732244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e52ce7d-80fb-423a-b464-8ca58ba92250 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:35.755310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-0e52ce7d-80fb-423a-b464-8ca58ba92250 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lazy-loading 'flavor' on Instance uuid a5ac9249-632c-47a0-9e4d-c755389099b6 {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:40:35.908965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1c2ab93f-827d-477c-8b39-9c2739e88fb1 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:35.910373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1c2ab93f-827d-477c-8b39-9c2739e88fb1 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:35.916187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1c2ab93f-827d-477c-8b39-9c2739e88fb1 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:35.916696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1c2ab93f-827d-477c-8b39-9c2739e88fb1 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:35.917469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1c2ab93f-827d-477c-8b39-9c2739e88fb1 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:35.917955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1c2ab93f-827d-477c-8b39-9c2739e88fb1 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:36.054233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1c2ab93f-827d-477c-8b39-9c2739e88fb1 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:36.061418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1c2ab93f-827d-477c-8b39-9c2739e88fb1 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.156160 Nov 08 17:40:36.062171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 184/393] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:35 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:36.087906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0e52ce7d-80fb-423a-b464-8ca58ba92250 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6/action" status: 200 len: 32 microversion: 2.1 time: 0.369894 Nov 08 17:40:36.088506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 210/394] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:35 2021] POST /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6/action => generated 32 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:40:36.098065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-96a7e280-affc-4c84-8cee-be066eb38a7e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:36.098711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-96a7e280-affc-4c84-8cee-be066eb38a7e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:36.105050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96a7e280-affc-4c84-8cee-be066eb38a7e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:36.105495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96a7e280-affc-4c84-8cee-be066eb38a7e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:36.106281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96a7e280-affc-4c84-8cee-be066eb38a7e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:36.106759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96a7e280-affc-4c84-8cee-be066eb38a7e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:36.244292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-96a7e280-affc-4c84-8cee-be066eb38a7e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:36.251884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-96a7e280-affc-4c84-8cee-be066eb38a7e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.157614 Nov 08 17:40:36.252467 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 185/395] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:36 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:36.629337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3c1b9538-635c-4d20-aad5-ae69b3dbd696 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dc0f0a1-78b3-465b-a0b7-47050eba15eb"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:36.631146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3c1b9538-635c-4d20-aad5-ae69b3dbd696 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:36.642346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c1b9538-635c-4d20-aad5-ae69b3dbd696 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:36.642346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c1b9538-635c-4d20-aad5-ae69b3dbd696 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:36.642346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c1b9538-635c-4d20-aad5-ae69b3dbd696 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:36.642346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c1b9538-635c-4d20-aad5-ae69b3dbd696 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.079067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ded80926-32e5-4d64-842b-0ad8473bd0ef tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:37.079772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ded80926-32e5-4d64-842b-0ad8473bd0ef tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:37.086571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ded80926-32e5-4d64-842b-0ad8473bd0ef tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.087010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ded80926-32e5-4d64-842b-0ad8473bd0ef tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.087932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ded80926-32e5-4d64-842b-0ad8473bd0ef tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.088440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ded80926-32e5-4d64-842b-0ad8473bd0ef tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.224383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ded80926-32e5-4d64-842b-0ad8473bd0ef tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:37.231909 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ded80926-32e5-4d64-842b-0ad8473bd0ef tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.156655 Nov 08 17:40:37.232474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 186/396] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:37 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:37.269791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b4f6e1f8-864e-4359-8753-2d37a5dc4161 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:37.270687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b4f6e1f8-864e-4359-8753-2d37a5dc4161 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:37.276503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b4f6e1f8-864e-4359-8753-2d37a5dc4161 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.277161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b4f6e1f8-864e-4359-8753-2d37a5dc4161 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.277931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b4f6e1f8-864e-4359-8753-2d37a5dc4161 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.278358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b4f6e1f8-864e-4359-8753-2d37a5dc4161 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.414242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b4f6e1f8-864e-4359-8753-2d37a5dc4161 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:37.421757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b4f6e1f8-864e-4359-8753-2d37a5dc4161 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.156046 Nov 08 17:40:37.433120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 187/397] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:37 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:37.565123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3c1b9538-635c-4d20-aad5-ae69b3dbd696 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940353 Nov 08 17:40:37.566835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 211/398] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:40:36 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/os-volume_attachments => generated 194 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:37.765622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ec2f7eae-6c05-46ca-a0c3-7cfb5756562d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:37.766440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ec2f7eae-6c05-46ca-a0c3-7cfb5756562d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:37.775531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec2f7eae-6c05-46ca-a0c3-7cfb5756562d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.775830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec2f7eae-6c05-46ca-a0c3-7cfb5756562d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.776494 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec2f7eae-6c05-46ca-a0c3-7cfb5756562d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.776970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec2f7eae-6c05-46ca-a0c3-7cfb5756562d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.800893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-ec2f7eae-6c05-46ca-a0c3-7cfb5756562d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lazy-loading 'flavor' on Instance uuid cf21b3ca-51f1-43c5-9b61-78422c205ff1 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:40:37.808258 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12049e74-4fd9-4037-a18e-7ddf37802b44"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:37.809713 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:37.817312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.818157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.819078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.819719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.897105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] HTTP exception thrown: Invalid volume: volume 12049e74-4fd9-4037-a18e-7ddf37802b44 is already attached to instances: 5f4f5525-8b55-43ab-a990-9d151f90f74a Nov 08 17:40:37.897692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Returning 400 to user: Invalid volume: volume 12049e74-4fd9-4037-a18e-7ddf37802b44 is already attached to instances: 5f4f5525-8b55-43ab-a990-9d151f90f74a {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:37.898555 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-11756930-c627-48fe-a7bd-3aa22931c4ad tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095710 Nov 08 17:40:37.899140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 212/399] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:40:37 2021] POST /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 08 17:40:37.957697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6cefef71-46ec-44da-acd6-ad37e93e69d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:37.958180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6cefef71-46ec-44da-acd6-ad37e93e69d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:37.964354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6cefef71-46ec-44da-acd6-ad37e93e69d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.964791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6cefef71-46ec-44da-acd6-ad37e93e69d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:37.965558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6cefef71-46ec-44da-acd6-ad37e93e69d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:37.965988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6cefef71-46ec-44da-acd6-ad37e93e69d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.091985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-6cefef71-46ec-44da-acd6-ad37e93e69d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lazy-loading 'services' on Instance uuid 5f4f5525-8b55-43ab-a990-9d151f90f74a {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:40:38.414037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6cefef71-46ec-44da-acd6-ad37e93e69d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments/12049e74-4fd9-4037-a18e-7ddf37802b44" status: 202 len: 0 microversion: 2.1 time: 0.459736 Nov 08 17:40:38.414644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 213/400] 10.222.0.18 () {58 vars in 1415 bytes} [Mon Nov 8 17:40:37 2021] DELETE /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments/12049e74-4fd9-4037-a18e-7ddf37802b44 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:38.419455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c92aeaf5-5ef7-4fc1-b829-c3088753cc1f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:38.420136 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c92aeaf5-5ef7-4fc1-b829-c3088753cc1f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:38.426914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c92aeaf5-5ef7-4fc1-b829-c3088753cc1f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.427350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c92aeaf5-5ef7-4fc1-b829-c3088753cc1f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.428115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c92aeaf5-5ef7-4fc1-b829-c3088753cc1f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.428541 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c92aeaf5-5ef7-4fc1-b829-c3088753cc1f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.578426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c92aeaf5-5ef7-4fc1-b829-c3088753cc1f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:38.590384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c92aeaf5-5ef7-4fc1-b829-c3088753cc1f tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.174411 Nov 08 17:40:38.591236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 214/401] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:38 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:38.596101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d7a65b12-51b2-4806-b979-2fcdc716a5cd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:38.597623 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d7a65b12-51b2-4806-b979-2fcdc716a5cd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:38.603987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7a65b12-51b2-4806-b979-2fcdc716a5cd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.604690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7a65b12-51b2-4806-b979-2fcdc716a5cd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.605750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7a65b12-51b2-4806-b979-2fcdc716a5cd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.606180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7a65b12-51b2-4806-b979-2fcdc716a5cd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.644320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d7a65b12-51b2-4806-b979-2fcdc716a5cd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051499 Nov 08 17:40:38.648591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 215/402] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:38 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:38.651521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5cf43b09-d254-437f-bf4b-468e59b11f06 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:38.652390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5cf43b09-d254-437f-bf4b-468e59b11f06 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:38.658400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5cf43b09-d254-437f-bf4b-468e59b11f06 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.658953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5cf43b09-d254-437f-bf4b-468e59b11f06 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.659840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5cf43b09-d254-437f-bf4b-468e59b11f06 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.660363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5cf43b09-d254-437f-bf4b-468e59b11f06 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.794888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ec2f7eae-6c05-46ca-a0c3-7cfb5756562d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 202 len: 0 microversion: 2.20 time: 1.031914 Nov 08 17:40:38.794888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 188/403] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:40:37 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 08 17:40:38.813208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-7999f51d-9662-4106-ae3d-d7a1ce45d308 req-d1127110-4a6e-45af-b817-1f71e060c2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3fb24d-d18a-48b3-9a3b-f432e1161786", "name": "network-vif-plugged", "status": "completed", "tag": "5f72aca0-6c46-4408-9132-c29029a06432"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:38.815199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:38.815199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:40:38.823897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-7999f51d-9662-4106-ae3d-d7a1ce45d308 req-d1127110-4a6e-45af-b817-1f71e060c2b5 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.824387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-7999f51d-9662-4106-ae3d-d7a1ce45d308 req-d1127110-4a6e-45af-b817-1f71e060c2b5 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.833455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5cf43b09-d254-437f-bf4b-468e59b11f06 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:38.841197 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5cf43b09-d254-437f-bf4b-468e59b11f06 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.193525 Nov 08 17:40:38.841772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 216/404] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:38 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:38.859737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:38.860335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:38.866280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-7999f51d-9662-4106-ae3d-d7a1ce45d308 req-d1127110-4a6e-45af-b817-1f71e060c2b5 service nova] Creating event network-vif-plugged:5f72aca0-6c46-4408-9132-c29029a06432 for instance 3b3fb24d-d18a-48b3-9a3b-f432e1161786 on hv-cinder-81689 Nov 08 17:40:38.871870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-7999f51d-9662-4106-ae3d-d7a1ce45d308 req-d1127110-4a6e-45af-b817-1f71e060c2b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075347 Nov 08 17:40:38.872890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 189/405] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:38.877172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.877818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:38.882564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:38.882564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:39.026261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:39.034694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:39.036209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:39.037407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-54a087ac-4dec-475d-904d-0bbcc15ec925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.181218 Nov 08 17:40:39.037913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 217/406] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:39.611860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1b2c3591-c596-40f1-9101-8f4bc93f5e22 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:39.613312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1b2c3591-c596-40f1-9101-8f4bc93f5e22 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:39.619527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1b2c3591-c596-40f1-9101-8f4bc93f5e22 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:39.619970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1b2c3591-c596-40f1-9101-8f4bc93f5e22 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:39.620723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1b2c3591-c596-40f1-9101-8f4bc93f5e22 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:39.621148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1b2c3591-c596-40f1-9101-8f4bc93f5e22 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:39.656166 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-86870f37-5c2a-42af-a952-36157d027e74 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:39.657166 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-86870f37-5c2a-42af-a952-36157d027e74 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:39.664462 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86870f37-5c2a-42af-a952-36157d027e74 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:39.664915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86870f37-5c2a-42af-a952-36157d027e74 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:39.665703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86870f37-5c2a-42af-a952-36157d027e74 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:39.666134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86870f37-5c2a-42af-a952-36157d027e74 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:39.697931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-86870f37-5c2a-42af-a952-36157d027e74 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045440 Nov 08 17:40:39.698518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 218/407] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:39 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:40:39.758915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1b2c3591-c596-40f1-9101-8f4bc93f5e22 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:39.766068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1b2c3591-c596-40f1-9101-8f4bc93f5e22 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.158740 Nov 08 17:40:39.766646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 190/408] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:39 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:39.863158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1c320b25-cf7f-43a7-8cdd-c82273c93a5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:39.863806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1c320b25-cf7f-43a7-8cdd-c82273c93a5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:39.869809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1c320b25-cf7f-43a7-8cdd-c82273c93a5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:39.874027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1c320b25-cf7f-43a7-8cdd-c82273c93a5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:39.874027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1c320b25-cf7f-43a7-8cdd-c82273c93a5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:39.874027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1c320b25-cf7f-43a7-8cdd-c82273c93a5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:40.002110 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1c320b25-cf7f-43a7-8cdd-c82273c93a5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:40.009734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1c320b25-cf7f-43a7-8cdd-c82273c93a5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.150895 Nov 08 17:40:40.010309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 219/409] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:39 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:40.056179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:40.056775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:40.062564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:40.063005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:40.063775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:40.064199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:40.192243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:40.201013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:40.202515 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:40.203655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-89ded872-a93b-4622-bbf9-2f475637539d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.151143 Nov 08 17:40:40.204208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 191/410] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:40:40.709742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8bfe1d6a-a019-488c-acdd-b03b4de5a20e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:40.710684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8bfe1d6a-a019-488c-acdd-b03b4de5a20e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:40.716664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8bfe1d6a-a019-488c-acdd-b03b4de5a20e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:40.717104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8bfe1d6a-a019-488c-acdd-b03b4de5a20e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:40.717882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8bfe1d6a-a019-488c-acdd-b03b4de5a20e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:40.718311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8bfe1d6a-a019-488c-acdd-b03b4de5a20e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:40.747620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8bfe1d6a-a019-488c-acdd-b03b4de5a20e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042052 Nov 08 17:40:40.748083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 220/411] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:40 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:40.782342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9485e6ce-5c71-495d-8929-a9b6340d72a7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:40.782964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9485e6ce-5c71-495d-8929-a9b6340d72a7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:40.789842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9485e6ce-5c71-495d-8929-a9b6340d72a7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:40.790282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9485e6ce-5c71-495d-8929-a9b6340d72a7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:40.791066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9485e6ce-5c71-495d-8929-a9b6340d72a7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:40.791493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9485e6ce-5c71-495d-8929-a9b6340d72a7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:40.946357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9485e6ce-5c71-495d-8929-a9b6340d72a7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:40.955870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9485e6ce-5c71-495d-8929-a9b6340d72a7 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1313 microversion: 2.1 time: 0.176970 Nov 08 17:40:40.957693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 192/412] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:40 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:41.027676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c7346c4e-3642-40ba-87b4-d45f11405524 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:41.028327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c7346c4e-3642-40ba-87b4-d45f11405524 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:41.038951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7346c4e-3642-40ba-87b4-d45f11405524 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:41.039400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7346c4e-3642-40ba-87b4-d45f11405524 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:41.040184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7346c4e-3642-40ba-87b4-d45f11405524 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:41.040617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7346c4e-3642-40ba-87b4-d45f11405524 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:41.205446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c7346c4e-3642-40ba-87b4-d45f11405524 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:41.213432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c7346c4e-3642-40ba-87b4-d45f11405524 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.190135 Nov 08 17:40:41.213994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 221/413] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:41 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:41.221509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:41.222393 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:41.228478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:41.228672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:41.229435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:41.229874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:41.405553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:41.413412 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:41.415146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:41.416289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bc070f64-b659-4c9b-b97e-642590a44347 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.198410 Nov 08 17:40:41.416846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 193/414] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:41.759469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c6fae364-8e53-4d45-97b6-9dd2e3193bc2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:41.760500 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c6fae364-8e53-4d45-97b6-9dd2e3193bc2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:41.769055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6fae364-8e53-4d45-97b6-9dd2e3193bc2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:41.769055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6fae364-8e53-4d45-97b6-9dd2e3193bc2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:41.769055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6fae364-8e53-4d45-97b6-9dd2e3193bc2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:41.769055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6fae364-8e53-4d45-97b6-9dd2e3193bc2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:41.801495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c6fae364-8e53-4d45-97b6-9dd2e3193bc2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Nov 08 17:40:41.802052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 222/415] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:41 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:41.973158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bc2277c8-1c17-453c-aa52-470fc2788060 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:41.973755 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bc2277c8-1c17-453c-aa52-470fc2788060 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:41.980051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc2277c8-1c17-453c-aa52-470fc2788060 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:41.980489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc2277c8-1c17-453c-aa52-470fc2788060 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:41.981251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc2277c8-1c17-453c-aa52-470fc2788060 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:41.981679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc2277c8-1c17-453c-aa52-470fc2788060 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:42.118323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bc2277c8-1c17-453c-aa52-470fc2788060 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:42.125431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bc2277c8-1c17-453c-aa52-470fc2788060 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1497 microversion: 2.1 time: 0.156523 Nov 08 17:40:42.125985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 194/416] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:41 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:42.230007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4a2bf45d-8d65-42f2-9996-70e38a16c51c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:42.230666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4a2bf45d-8d65-42f2-9996-70e38a16c51c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:42.237464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a2bf45d-8d65-42f2-9996-70e38a16c51c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:42.237725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a2bf45d-8d65-42f2-9996-70e38a16c51c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:42.238547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a2bf45d-8d65-42f2-9996-70e38a16c51c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:42.238989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a2bf45d-8d65-42f2-9996-70e38a16c51c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:42.435595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:42.439962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:42.446672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:42.447202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:42.448129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:42.448564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:42.498937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4a2bf45d-8d65-42f2-9996-70e38a16c51c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:42.507081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4a2bf45d-8d65-42f2-9996-70e38a16c51c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.280767 Nov 08 17:40:42.507662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 223/417] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:42 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:42.592979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:42.602026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:42.604347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:42.605424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ffe318b8-cc1d-4230-8b41-36bac6f2cd22 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.174150 Nov 08 17:40:42.606055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 195/418] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:42.813243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-15616c26-e1db-452c-8b62-a2026a16deed tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:42.814214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-15616c26-e1db-452c-8b62-a2026a16deed tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:42.820483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-15616c26-e1db-452c-8b62-a2026a16deed tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:42.820930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-15616c26-e1db-452c-8b62-a2026a16deed tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:42.821704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-15616c26-e1db-452c-8b62-a2026a16deed tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:42.822140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-15616c26-e1db-452c-8b62-a2026a16deed tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:42.851417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-15616c26-e1db-452c-8b62-a2026a16deed tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Nov 08 17:40:42.851974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 224/419] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:42 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:43.113393 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-36139b59-8992-4f05-a1e6-2d18d5f6eab9 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:43.113931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-36139b59-8992-4f05-a1e6-2d18d5f6eab9 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:43.120474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36139b59-8992-4f05-a1e6-2d18d5f6eab9 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.120908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36139b59-8992-4f05-a1e6-2d18d5f6eab9 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.121683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36139b59-8992-4f05-a1e6-2d18d5f6eab9 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.122090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36139b59-8992-4f05-a1e6-2d18d5f6eab9 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.146691 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-36139b59-8992-4f05-a1e6-2d18d5f6eab9 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Going to try to terminate instance {{(pid=127763) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:40:43.448096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-36139b59-8992-4f05-a1e6-2d18d5f6eab9 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 204 len: 0 microversion: 2.1 time: 0.337937 Nov 08 17:40:43.448714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 196/420] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:40:43 2021] DELETE /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:40:43.456634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bbe0452a-a592-4787-946a-70030d266c25 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:43.459724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bbe0452a-a592-4787-946a-70030d266c25 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:43.463519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bbe0452a-a592-4787-946a-70030d266c25 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.463937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bbe0452a-a592-4787-946a-70030d266c25 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.464696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bbe0452a-a592-4787-946a-70030d266c25 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.465124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bbe0452a-a592-4787-946a-70030d266c25 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.524289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-da3ac6e4-fe05-4cfd-896b-adfb0542d667 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:43.525077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-da3ac6e4-fe05-4cfd-896b-adfb0542d667 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:43.531366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da3ac6e4-fe05-4cfd-896b-adfb0542d667 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.534810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da3ac6e4-fe05-4cfd-896b-adfb0542d667 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.534810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da3ac6e4-fe05-4cfd-896b-adfb0542d667 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.534810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da3ac6e4-fe05-4cfd-896b-adfb0542d667 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.638967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bbe0452a-a592-4787-946a-70030d266c25 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:43.646914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bbe0452a-a592-4787-946a-70030d266c25 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1503 microversion: 2.1 time: 0.193994 Nov 08 17:40:43.647712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 225/421] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:43 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:43.652470 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:43.653286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:43.660847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.661553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.662339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.662791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.711543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-da3ac6e4-fe05-4cfd-896b-adfb0542d667 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:43.718962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-da3ac6e4-fe05-4cfd-896b-adfb0542d667 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.198657 Nov 08 17:40:43.719538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 197/422] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:43 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:43.801027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:43.807957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:43.809451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:43.810611 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e82786f4-283e-4c08-855a-073cac0e4784 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.161776 Nov 08 17:40:43.811167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 226/423] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:43.861858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2ce6e28c-26a9-4dbc-beba-a20b93c9fa04 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:43.863500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2ce6e28c-26a9-4dbc-beba-a20b93c9fa04 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:43.869561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ce6e28c-26a9-4dbc-beba-a20b93c9fa04 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.870004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ce6e28c-26a9-4dbc-beba-a20b93c9fa04 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.870792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ce6e28c-26a9-4dbc-beba-a20b93c9fa04 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:43.871227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ce6e28c-26a9-4dbc-beba-a20b93c9fa04 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:43.900111 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2ce6e28c-26a9-4dbc-beba-a20b93c9fa04 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041833 Nov 08 17:40:43.900770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 198/424] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:43 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:44.665598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-69dba5b1-1778-439b-a54b-2631d9f75db4 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:44.666633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-69dba5b1-1778-439b-a54b-2631d9f75db4 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:44.673471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-69dba5b1-1778-439b-a54b-2631d9f75db4 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:44.673950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-69dba5b1-1778-439b-a54b-2631d9f75db4 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:44.674884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-69dba5b1-1778-439b-a54b-2631d9f75db4 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:44.675320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-69dba5b1-1778-439b-a54b-2631d9f75db4 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:44.770813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-02cc65f3-94a8-4492-b438-d0d2b21d599d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:44.770813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-02cc65f3-94a8-4492-b438-d0d2b21d599d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:44.770813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02cc65f3-94a8-4492-b438-d0d2b21d599d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:44.770813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02cc65f3-94a8-4492-b438-d0d2b21d599d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:44.772060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02cc65f3-94a8-4492-b438-d0d2b21d599d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:44.772060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02cc65f3-94a8-4492-b438-d0d2b21d599d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:44.843876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-69dba5b1-1778-439b-a54b-2631d9f75db4 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:44.852068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-69dba5b1-1778-439b-a54b-2631d9f75db4 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1503 microversion: 2.1 time: 0.190730 Nov 08 17:40:44.852945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 227/425] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:44 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:44.865917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:44.866636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:44.876625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:44.877140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:44.878574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:44.879073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:44.916068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-02cc65f3-94a8-4492-b438-d0d2b21d599d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:44.923624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-02cc65f3-94a8-4492-b438-d0d2b21d599d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.190540 Nov 08 17:40:44.924253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 199/426] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:44 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:44.929107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-14d788d6-acac-49e6-bcbb-73bf22f43100 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:44.930058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-14d788d6-acac-49e6-bcbb-73bf22f43100 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:44.936022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14d788d6-acac-49e6-bcbb-73bf22f43100 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:44.936466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14d788d6-acac-49e6-bcbb-73bf22f43100 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:44.937241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14d788d6-acac-49e6-bcbb-73bf22f43100 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:44.937670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14d788d6-acac-49e6-bcbb-73bf22f43100 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:44.967422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-14d788d6-acac-49e6-bcbb-73bf22f43100 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041965 Nov 08 17:40:44.967985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 200/427] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:44 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:45.025382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:45.033346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:45.034892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:45.036089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-34568457-c6f9-4916-aefd-d08e638e27f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.181933 Nov 08 17:40:45.036642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 228/428] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:45.869724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-29267ff9-2759-4b54-9ed0-bf8a8d37dc6d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:45.873985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-29267ff9-2759-4b54-9ed0-bf8a8d37dc6d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:45.876668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-29267ff9-2759-4b54-9ed0-bf8a8d37dc6d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:45.877113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-29267ff9-2759-4b54-9ed0-bf8a8d37dc6d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:45.877936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-29267ff9-2759-4b54-9ed0-bf8a8d37dc6d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:45.878363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-29267ff9-2759-4b54-9ed0-bf8a8d37dc6d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:45.940407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-05343650-1563-4202-91bf-922e9e0ea856 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:45.940993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-05343650-1563-4202-91bf-922e9e0ea856 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:45.947782 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05343650-1563-4202-91bf-922e9e0ea856 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:45.948233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05343650-1563-4202-91bf-922e9e0ea856 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:45.949010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05343650-1563-4202-91bf-922e9e0ea856 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:45.949446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05343650-1563-4202-91bf-922e9e0ea856 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.076905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-29267ff9-2759-4b54-9ed0-bf8a8d37dc6d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:46.093614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-29267ff9-2759-4b54-9ed0-bf8a8d37dc6d tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1503 microversion: 2.1 time: 0.228095 Nov 08 17:40:46.098028 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 201/429] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:45 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:46.114721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-452058ae-7825-4995-90a6-5d88fa56019c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:46.114721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-452058ae-7825-4995-90a6-5d88fa56019c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:46.126607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-452058ae-7825-4995-90a6-5d88fa56019c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:46.127428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-452058ae-7825-4995-90a6-5d88fa56019c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.128405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-452058ae-7825-4995-90a6-5d88fa56019c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:46.129161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-452058ae-7825-4995-90a6-5d88fa56019c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.157906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-05343650-1563-4202-91bf-922e9e0ea856 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:46.164683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-452058ae-7825-4995-90a6-5d88fa56019c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065221 Nov 08 17:40:46.166667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 202/430] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:46 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:46.171285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:46.172044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:46.177273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-05343650-1563-4202-91bf-922e9e0ea856 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.239462 Nov 08 17:40:46.178670 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 229/431] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:45 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:46.179188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:46.179736 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.180663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:46.181239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.184412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-00ed8ed2-52a3-4647-bb1f-69cee9cf8d43 req-d5b9a257-d261-4586-a8ea-78300d284c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3fb24d-d18a-48b3-9a3b-f432e1161786", "name": "network-vif-deleted", "tag": "5f72aca0-6c46-4408-9132-c29029a06432"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:46.187076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:46.187076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:46.196134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-00ed8ed2-52a3-4647-bb1f-69cee9cf8d43 req-d5b9a257-d261-4586-a8ea-78300d284c48 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:46.196875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-00ed8ed2-52a3-4647-bb1f-69cee9cf8d43 req-d5b9a257-d261-4586-a8ea-78300d284c48 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.219597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-00ed8ed2-52a3-4647-bb1f-69cee9cf8d43 req-d5b9a257-d261-4586-a8ea-78300d284c48 service nova] Creating event network-vif-deleted:5f72aca0-6c46-4408-9132-c29029a06432 for instance 3b3fb24d-d18a-48b3-9a3b-f432e1161786 on hv-cinder-81689 Nov 08 17:40:46.229437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-00ed8ed2-52a3-4647-bb1f-69cee9cf8d43 req-d5b9a257-d261-4586-a8ea-78300d284c48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048575 Nov 08 17:40:46.230197 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 230/432] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:40:46.312783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-39af7ace-ea33-430b-b1f4-4d136f2da062 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:46.330860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39af7ace-ea33-430b-b1f4-4d136f2da062 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:46.331648 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39af7ace-ea33-430b-b1f4-4d136f2da062 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.359972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:46.370583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:46.372334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:46.373475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-266b6448-7408-4530-a0c3-3a2d2402ec06 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.205852 Nov 08 17:40:46.374272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 203/433] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:46.400431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-39af7ace-ea33-430b-b1f4-4d136f2da062 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Going to try to stop instance {{(pid=127762) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 08 17:40:46.680248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-39af7ace-ea33-430b-b1f4-4d136f2da062 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 202 len: 0 microversion: 2.1 time: 0.377553 Nov 08 17:40:46.680886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 231/434] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:40:46 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:40:46.689382 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0bbf216d-ccf0-4c0c-b6be-ee9da2a9513d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:46.690127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0bbf216d-ccf0-4c0c-b6be-ee9da2a9513d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:46.696771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bbf216d-ccf0-4c0c-b6be-ee9da2a9513d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:46.697256 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bbf216d-ccf0-4c0c-b6be-ee9da2a9513d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.698111 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bbf216d-ccf0-4c0c-b6be-ee9da2a9513d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:46.698686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bbf216d-ccf0-4c0c-b6be-ee9da2a9513d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:46.833608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0bbf216d-ccf0-4c0c-b6be-ee9da2a9513d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:46.841684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0bbf216d-ccf0-4c0c-b6be-ee9da2a9513d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.156417 Nov 08 17:40:46.843358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 204/435] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:46 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:47.115398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:47.116114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:47.122407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.123739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.124002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.124592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.171916 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.172388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.172844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lazy-loading 'fault' on Instance uuid 3b3fb24d-d18a-48b3-9a3b-f432e1161786 {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:40:47.182017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-df59e5e1-ae88-49fc-b636-ec9290713435 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:47.183054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-df59e5e1-ae88-49fc-b636-ec9290713435 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:47.192314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df59e5e1-ae88-49fc-b636-ec9290713435 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.193016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df59e5e1-ae88-49fc-b636-ec9290713435 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.196252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df59e5e1-ae88-49fc-b636-ec9290713435 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.196706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df59e5e1-ae88-49fc-b636-ec9290713435 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.225598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cc50d8aef6145358cf9563338a5321c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b49281015470ba0eb03102015c072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:47.233144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f2a5428b-349c-4151-9f54-39fccb313f04 tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 200 len: 1303 microversion: 2.1 time: 0.122600 Nov 08 17:40:47.233777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 232/436] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:47 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:47.242665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-df59e5e1-ae88-49fc-b636-ec9290713435 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065358 Nov 08 17:40:47.243531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 205/437] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:40:47 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 17:40:47.246734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ac81b878-bc4e-4679-9edc-504e79c7900c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:47.253807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ac81b878-bc4e-4679-9edc-504e79c7900c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:47.253807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac81b878-bc4e-4679-9edc-504e79c7900c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.253807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac81b878-bc4e-4679-9edc-504e79c7900c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.255005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac81b878-bc4e-4679-9edc-504e79c7900c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.255440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac81b878-bc4e-4679-9edc-504e79c7900c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.397118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:47.399327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:47.411466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.411466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.411466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.411466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.416908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ac81b878-bc4e-4679-9edc-504e79c7900c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:47.425475 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ac81b878-bc4e-4679-9edc-504e79c7900c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.189330 Nov 08 17:40:47.426818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 233/438] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:47 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:47.432956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1080126839", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "networks": [{"uuid": "7538bf23-b616-4166-98b8-7a0c2b2bdf89"}]}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:47.485814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.network.neutron [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] validate_networks() for [('7538bf23-b616-4166-98b8-7a0c2b2bdf89', None, None, None, None, None)] {{(pid=127762) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:40:47.610771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:47.619174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:47.620685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:47.621840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6103a621-5cb3-4be0-9c99-d5a0332bef11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.232471 Nov 08 17:40:47.622395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 206/439] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:47.861336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-00d5a9dd-5246-428a-b130-126ecc2983f8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:47.862232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-00d5a9dd-5246-428a-b130-126ecc2983f8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:47.868673 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-00d5a9dd-5246-428a-b130-126ecc2983f8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.869332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-00d5a9dd-5246-428a-b130-126ecc2983f8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:47.870284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-00d5a9dd-5246-428a-b130-126ecc2983f8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:47.870779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-00d5a9dd-5246-428a-b130-126ecc2983f8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.153201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Flavor limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:40:48.153712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Image limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:40:48.154069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Flavor pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:40:48.154504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Image pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:40:48.154916 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:40:48.164725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:48.165163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.165956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:48.166378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.183381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Getting quotas for project ef1c05515852427e84b12522c50545fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:40:48.188554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Getting quotas for user 6ca86df4b2b6476fae354e9e96fbdf53 and project ef1c05515852427e84b12522c50545fd. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:40:48.188790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-00d5a9dd-5246-428a-b130-126ecc2983f8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:48.197083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-00d5a9dd-5246-428a-b130-126ecc2983f8 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.339796 Nov 08 17:40:48.197657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 207/440] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:47 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:48.202029 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Going to run 1 instances... {{(pid=127762) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:40:48.204496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:40:48.250697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:48.251301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] [instance: 3b3fb24d-d18a-48b3-9a3b-f432e1161786] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:48.257619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:48.258060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.258863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:48.259303 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.272640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] HTTP exception thrown: Instance 3b3fb24d-d18a-48b3-9a3b-f432e1161786 could not be found. Nov 08 17:40:48.273227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] Returning 404 to user: Instance 3b3fb24d-d18a-48b3-9a3b-f432e1161786 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:40:48.274100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ce44df99-91a9-4a92-8ae7-c89c4da256de tempest-VolumesActionsTest-907739590 tempest-VolumesActionsTest-907739590-project] 10.222.0.18 "GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786" status: 404 len: 111 microversion: 2.1 time: 0.027177 Nov 08 17:40:48.274653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 208/441] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:48 2021] GET /compute/v2.1/servers/3b3fb24d-d18a-48b3-9a3b-f432e1161786 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 17:40:48.320388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cf0537a1-7846-48d5-a5f2-cd337024c326 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892530 Nov 08 17:40:48.321026 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 234/442] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:40:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:40:48.330729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b9576f12-188e-40d9-8390-90440b1d77d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:48.331368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b9576f12-188e-40d9-8390-90440b1d77d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:48.388017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b9576f12-188e-40d9-8390-90440b1d77d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:48.395634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b9576f12-188e-40d9-8390-90440b1d77d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1218 microversion: 2.1 time: 0.067837 Nov 08 17:40:48.395789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 209/443] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:48 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:48.446634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a2b0ac25-d658-4768-962e-6b5018ea41a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:48.446634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a2b0ac25-d658-4768-962e-6b5018ea41a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:48.450348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a2b0ac25-d658-4768-962e-6b5018ea41a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:48.450869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a2b0ac25-d658-4768-962e-6b5018ea41a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.451668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a2b0ac25-d658-4768-962e-6b5018ea41a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:48.452051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a2b0ac25-d658-4768-962e-6b5018ea41a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.599386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a2b0ac25-d658-4768-962e-6b5018ea41a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:48.607618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a2b0ac25-d658-4768-962e-6b5018ea41a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.168623 Nov 08 17:40:48.608329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 235/444] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:48 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:48.641033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:48.641632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:48.648241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:48.648709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.649493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:48.649922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:48.794068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:48.802922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:48.803422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:48.804588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dc19539d-2480-4988-aaa0-81120f68ae74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.167525 Nov 08 17:40:48.805434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 210/445] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:49.214989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d654f091-f244-4378-b759-3015d565f3f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:49.215587 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d654f091-f244-4378-b759-3015d565f3f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:49.222799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d654f091-f244-4378-b759-3015d565f3f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:49.223791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d654f091-f244-4378-b759-3015d565f3f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:49.224841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d654f091-f244-4378-b759-3015d565f3f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:49.225279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d654f091-f244-4378-b759-3015d565f3f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:49.371793 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d654f091-f244-4378-b759-3015d565f3f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:49.380306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d654f091-f244-4378-b759-3015d565f3f3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.168985 Nov 08 17:40:49.380876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 236/446] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:49 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:49.415887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2dbfbca9-c979-463e-a5df-4cc36af4f4b5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:49.416522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2dbfbca9-c979-463e-a5df-4cc36af4f4b5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:49.423215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dbfbca9-c979-463e-a5df-4cc36af4f4b5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:49.423671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dbfbca9-c979-463e-a5df-4cc36af4f4b5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:49.424469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dbfbca9-c979-463e-a5df-4cc36af4f4b5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:49.424900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dbfbca9-c979-463e-a5df-4cc36af4f4b5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:49.492578 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2dbfbca9-c979-463e-a5df-4cc36af4f4b5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:49.500738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2dbfbca9-c979-463e-a5df-4cc36af4f4b5 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1222 microversion: 2.1 time: 0.088891 Nov 08 17:40:49.502346 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 211/447] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:49 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:49.625702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2ec7d5a3-2680-4cea-97a0-1dcbd26e00a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:49.626706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2ec7d5a3-2680-4cea-97a0-1dcbd26e00a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:49.633936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2ec7d5a3-2680-4cea-97a0-1dcbd26e00a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:49.634859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2ec7d5a3-2680-4cea-97a0-1dcbd26e00a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:49.635712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2ec7d5a3-2680-4cea-97a0-1dcbd26e00a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:49.636252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2ec7d5a3-2680-4cea-97a0-1dcbd26e00a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:49.785790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2ec7d5a3-2680-4cea-97a0-1dcbd26e00a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:49.793394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2ec7d5a3-2680-4cea-97a0-1dcbd26e00a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.171423 Nov 08 17:40:49.833059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 237/448] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:49 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:49.833214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:49.833214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:49.833214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:49.833214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:49.833534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:49.833534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:49.961525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:49.969429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:49.970945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:49.972080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d4fadb85-f2ae-4935-a9f5-36f09a41bea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.152436 Nov 08 17:40:49.972685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 212/449] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:50.398254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ccd904b4-b3e1-4414-9fe8-d83c5bc1900d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:50.398986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ccd904b4-b3e1-4414-9fe8-d83c5bc1900d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:50.405248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ccd904b4-b3e1-4414-9fe8-d83c5bc1900d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:50.405880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ccd904b4-b3e1-4414-9fe8-d83c5bc1900d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:50.409312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ccd904b4-b3e1-4414-9fe8-d83c5bc1900d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:50.409312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ccd904b4-b3e1-4414-9fe8-d83c5bc1900d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:50.521036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7465f8f0-9056-4cdb-99ae-d49fc0c36911 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:50.521539 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7465f8f0-9056-4cdb-99ae-d49fc0c36911 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:50.534865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7465f8f0-9056-4cdb-99ae-d49fc0c36911 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:50.535993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7465f8f0-9056-4cdb-99ae-d49fc0c36911 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:50.536775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7465f8f0-9056-4cdb-99ae-d49fc0c36911 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:50.537285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7465f8f0-9056-4cdb-99ae-d49fc0c36911 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:50.547775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ccd904b4-b3e1-4414-9fe8-d83c5bc1900d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:50.556227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ccd904b4-b3e1-4414-9fe8-d83c5bc1900d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.162961 Nov 08 17:40:50.556999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 238/450] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:50 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:50.595340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7465f8f0-9056-4cdb-99ae-d49fc0c36911 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:50.603122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7465f8f0-9056-4cdb-99ae-d49fc0c36911 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1270 microversion: 2.1 time: 0.087284 Nov 08 17:40:50.603759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 213/451] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:50 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:50.847396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f86622d6-a45a-4f30-be4f-5fd6f467090e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:50.848202 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f86622d6-a45a-4f30-be4f-5fd6f467090e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:50.853920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f86622d6-a45a-4f30-be4f-5fd6f467090e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:50.854363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f86622d6-a45a-4f30-be4f-5fd6f467090e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:50.855152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f86622d6-a45a-4f30-be4f-5fd6f467090e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:50.855586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f86622d6-a45a-4f30-be4f-5fd6f467090e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:50.982427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f86622d6-a45a-4f30-be4f-5fd6f467090e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:50.989994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f86622d6-a45a-4f30-be4f-5fd6f467090e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.146104 Nov 08 17:40:50.990401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:50.991089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:50.993156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 239/452] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:50 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:50.997963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:50.998404 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:50.999336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:50.999789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:51.129886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:51.137486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:51.139005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:51.140148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a05d03d5-1ef7-46d7-b0eb-13b702bb61d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.153489 Nov 08 17:40:51.140706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 214/453] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:40:51.573195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1fa996e5-ee19-436e-bddd-025169690e83 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:51.573805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1fa996e5-ee19-436e-bddd-025169690e83 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:51.580171 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1fa996e5-ee19-436e-bddd-025169690e83 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:51.580624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1fa996e5-ee19-436e-bddd-025169690e83 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:51.581429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1fa996e5-ee19-436e-bddd-025169690e83 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:51.581901 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1fa996e5-ee19-436e-bddd-025169690e83 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:51.620679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0a61d9f2-f699-4dc1-ac49-a1a6063b163a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:51.621375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0a61d9f2-f699-4dc1-ac49-a1a6063b163a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:51.627666 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a61d9f2-f699-4dc1-ac49-a1a6063b163a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:51.628170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a61d9f2-f699-4dc1-ac49-a1a6063b163a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:51.629214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a61d9f2-f699-4dc1-ac49-a1a6063b163a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:51.629647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a61d9f2-f699-4dc1-ac49-a1a6063b163a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:51.696143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0a61d9f2-f699-4dc1-ac49-a1a6063b163a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:51.704500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0a61d9f2-f699-4dc1-ac49-a1a6063b163a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1270 microversion: 2.1 time: 0.087615 Nov 08 17:40:51.705134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 215/454] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:51 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:51.731424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1fa996e5-ee19-436e-bddd-025169690e83 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:51.740425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1fa996e5-ee19-436e-bddd-025169690e83 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.170861 Nov 08 17:40:51.741084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 240/455] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:51 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:52.009317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fe078583-efcf-46bd-87c4-28b83905bd16 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:52.010004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fe078583-efcf-46bd-87c4-28b83905bd16 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:52.017260 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe078583-efcf-46bd-87c4-28b83905bd16 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:52.017696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe078583-efcf-46bd-87c4-28b83905bd16 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:52.019145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe078583-efcf-46bd-87c4-28b83905bd16 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:52.020099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe078583-efcf-46bd-87c4-28b83905bd16 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:52.154239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fe078583-efcf-46bd-87c4-28b83905bd16 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:52.159069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:52.159662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:52.162796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fe078583-efcf-46bd-87c4-28b83905bd16 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.157423 Nov 08 17:40:52.163469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 216/456] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:52 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:52.166403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:52.166869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:52.167951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:52.168057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:52.295088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:52.302847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:52.304346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:52.305523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0b6cb923-c978-493a-8087-09ae5c838d80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.150155 Nov 08 17:40:52.306079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 241/457] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:40:52.720765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9441d6ea-b33b-439d-8f2f-a35e7a90c667 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:52.721370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9441d6ea-b33b-439d-8f2f-a35e7a90c667 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:52.728215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9441d6ea-b33b-439d-8f2f-a35e7a90c667 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:52.728659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9441d6ea-b33b-439d-8f2f-a35e7a90c667 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:52.729423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9441d6ea-b33b-439d-8f2f-a35e7a90c667 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:52.729860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9441d6ea-b33b-439d-8f2f-a35e7a90c667 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:52.757482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2445d804-0b9c-4e0f-bf09-0b37bc23e7b4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:52.758080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2445d804-0b9c-4e0f-bf09-0b37bc23e7b4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:52.764342 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2445d804-0b9c-4e0f-bf09-0b37bc23e7b4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:52.764788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2445d804-0b9c-4e0f-bf09-0b37bc23e7b4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:52.765551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2445d804-0b9c-4e0f-bf09-0b37bc23e7b4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:52.765973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2445d804-0b9c-4e0f-bf09-0b37bc23e7b4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:52.788640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9441d6ea-b33b-439d-8f2f-a35e7a90c667 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:52.795693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9441d6ea-b33b-439d-8f2f-a35e7a90c667 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1270 microversion: 2.1 time: 0.078540 Nov 08 17:40:52.796269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 217/458] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:52 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:52.895831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2445d804-0b9c-4e0f-bf09-0b37bc23e7b4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:52.903422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2445d804-0b9c-4e0f-bf09-0b37bc23e7b4 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.149549 Nov 08 17:40:52.903984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 242/459] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:52 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:53.179919 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b367b1a3-56ec-42c6-9a79-1a11f0e16c8a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:53.180609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b367b1a3-56ec-42c6-9a79-1a11f0e16c8a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:53.186396 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b367b1a3-56ec-42c6-9a79-1a11f0e16c8a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:53.186875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b367b1a3-56ec-42c6-9a79-1a11f0e16c8a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:53.187641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b367b1a3-56ec-42c6-9a79-1a11f0e16c8a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:53.188073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b367b1a3-56ec-42c6-9a79-1a11f0e16c8a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:53.320402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b367b1a3-56ec-42c6-9a79-1a11f0e16c8a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:53.323536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:53.324243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:53.327740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b367b1a3-56ec-42c6-9a79-1a11f0e16c8a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.151610 Nov 08 17:40:53.330737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 218/460] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:53 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:53.330846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:53.331119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:53.332535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:53.333201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:53.473340 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:53.483485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:53.485010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:53.486268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fa7b86ea-4d1b-4376-90ef-17781071f640 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.166532 Nov 08 17:40:53.486845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 243/461] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:40:53.812659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dc3128dd-af7b-4fa4-9516-089a62371cce tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:53.813209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dc3128dd-af7b-4fa4-9516-089a62371cce tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:53.821297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dc3128dd-af7b-4fa4-9516-089a62371cce tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:53.821799 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dc3128dd-af7b-4fa4-9516-089a62371cce tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:53.822646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dc3128dd-af7b-4fa4-9516-089a62371cce tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:53.823127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dc3128dd-af7b-4fa4-9516-089a62371cce tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:53.896434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dc3128dd-af7b-4fa4-9516-089a62371cce tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:53.904434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dc3128dd-af7b-4fa4-9516-089a62371cce tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1278 microversion: 2.1 time: 0.095823 Nov 08 17:40:53.905031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 219/462] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:53 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:53.928440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d44e5860-d41b-4078-9118-e988476d1472 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:53.929046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d44e5860-d41b-4078-9118-e988476d1472 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:53.936935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d44e5860-d41b-4078-9118-e988476d1472 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:53.937376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d44e5860-d41b-4078-9118-e988476d1472 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:53.938262 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d44e5860-d41b-4078-9118-e988476d1472 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:53.943387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d44e5860-d41b-4078-9118-e988476d1472 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:54.101555 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d44e5860-d41b-4078-9118-e988476d1472 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:54.109951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d44e5860-d41b-4078-9118-e988476d1472 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.187899 Nov 08 17:40:54.110643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 244/463] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:53 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:54.345620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-87f3d3fa-64b1-4be3-bcfb-f896615fe56f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:54.346243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-87f3d3fa-64b1-4be3-bcfb-f896615fe56f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:54.353288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-87f3d3fa-64b1-4be3-bcfb-f896615fe56f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:54.353737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-87f3d3fa-64b1-4be3-bcfb-f896615fe56f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:54.354604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-87f3d3fa-64b1-4be3-bcfb-f896615fe56f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:54.355049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-87f3d3fa-64b1-4be3-bcfb-f896615fe56f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:54.484701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-87f3d3fa-64b1-4be3-bcfb-f896615fe56f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:54.492910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-87f3d3fa-64b1-4be3-bcfb-f896615fe56f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.151321 Nov 08 17:40:54.493478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 220/464] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:54 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:54.505865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:54.506499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:54.512375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:54.512822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:54.513636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:54.514080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:54.676060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:54.684123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:54.685752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:54.687073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4b76172e-9bc3-4378-92fb-f28a95db7d37 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1721 microversion: 2.20 time: 0.186004 Nov 08 17:40:54.687629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 245/465] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:54.922129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-26fe38c8-a18f-40d7-acb7-5dcb08d5fddd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:54.929739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-26fe38c8-a18f-40d7-acb7-5dcb08d5fddd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:54.931650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26fe38c8-a18f-40d7-acb7-5dcb08d5fddd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:54.932178 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26fe38c8-a18f-40d7-acb7-5dcb08d5fddd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:54.933160 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26fe38c8-a18f-40d7-acb7-5dcb08d5fddd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:54.933778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26fe38c8-a18f-40d7-acb7-5dcb08d5fddd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:55.092656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-26fe38c8-a18f-40d7-acb7-5dcb08d5fddd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:55.100914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-26fe38c8-a18f-40d7-acb7-5dcb08d5fddd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.182353 Nov 08 17:40:55.101492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 221/466] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:54 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:55.128211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-883e95af-f5e1-4792-a606-e26a12da8b6e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:55.129456 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-883e95af-f5e1-4792-a606-e26a12da8b6e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:55.135996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-883e95af-f5e1-4792-a606-e26a12da8b6e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:55.136449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-883e95af-f5e1-4792-a606-e26a12da8b6e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:55.137232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-883e95af-f5e1-4792-a606-e26a12da8b6e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:55.137666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-883e95af-f5e1-4792-a606-e26a12da8b6e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:55.339076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-883e95af-f5e1-4792-a606-e26a12da8b6e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:55.349483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-883e95af-f5e1-4792-a606-e26a12da8b6e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.222945 Nov 08 17:40:55.360299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 246/467] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:55 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:55.511967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-88340522-3dad-48f5-9ee9-d382a9a20f7c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:55.513248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-88340522-3dad-48f5-9ee9-d382a9a20f7c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:55.520558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-88340522-3dad-48f5-9ee9-d382a9a20f7c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:55.521357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-88340522-3dad-48f5-9ee9-d382a9a20f7c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:55.527823 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-88340522-3dad-48f5-9ee9-d382a9a20f7c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:55.527823 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-88340522-3dad-48f5-9ee9-d382a9a20f7c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:55.622683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-3eecbab8-70ba-48ae-9622-1f4271fcbc25 req-a2114e6b-ae18-412b-bfa6-4f5755c3fa4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1b9538-1890-433c-9a61-e95fa423b0ed", "tag": "d6088382-accd-47df-bbc8-f5b6496f749e"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:55.625382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:55.625382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:55.643163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-3eecbab8-70ba-48ae-9622-1f4271fcbc25 req-a2114e6b-ae18-412b-bfa6-4f5755c3fa4a service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:55.645386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-3eecbab8-70ba-48ae-9622-1f4271fcbc25 req-a2114e6b-ae18-412b-bfa6-4f5755c3fa4a service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:55.679102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-3eecbab8-70ba-48ae-9622-1f4271fcbc25 req-a2114e6b-ae18-412b-bfa6-4f5755c3fa4a service nova] Creating event network-changed:d6088382-accd-47df-bbc8-f5b6496f749e for instance 2e1b9538-1890-433c-9a61-e95fa423b0ed on hv-cinder-81689 Nov 08 17:40:55.702630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-3eecbab8-70ba-48ae-9622-1f4271fcbc25 req-a2114e6b-ae18-412b-bfa6-4f5755c3fa4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083505 Nov 08 17:40:55.703251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 247/468] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:40:55.715041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:55.715871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:55.727734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:55.728352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:55.729319 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:55.730046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:55.930504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-88340522-3dad-48f5-9ee9-d382a9a20f7c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:55.938698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-88340522-3dad-48f5-9ee9-d382a9a20f7c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.431779 Nov 08 17:40:55.939281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 222/469] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:55 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:56.120731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:56.123096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f8533d3d-db96-47a2-9682-25dbd8e2160b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:56.126621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f8533d3d-db96-47a2-9682-25dbd8e2160b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:56.137747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:56.139069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8533d3d-db96-47a2-9682-25dbd8e2160b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:56.139729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8533d3d-db96-47a2-9682-25dbd8e2160b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:56.141508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:56.142582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8533d3d-db96-47a2-9682-25dbd8e2160b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:56.143262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8533d3d-db96-47a2-9682-25dbd8e2160b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:56.147797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-357ba095-762d-4fa3-8809-6246f23aa06d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1742 microversion: 2.20 time: 0.443019 Nov 08 17:40:56.151783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 248/470] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1742 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:56.375663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c432a178-ae30-4ecb-a4e9-f9ed3dc58e16 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:56.377420 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c432a178-ae30-4ecb-a4e9-f9ed3dc58e16 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:56.392108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c432a178-ae30-4ecb-a4e9-f9ed3dc58e16 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:56.392827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c432a178-ae30-4ecb-a4e9-f9ed3dc58e16 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:56.394833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c432a178-ae30-4ecb-a4e9-f9ed3dc58e16 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:56.395736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c432a178-ae30-4ecb-a4e9-f9ed3dc58e16 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:56.409557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f8533d3d-db96-47a2-9682-25dbd8e2160b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:56.422326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f8533d3d-db96-47a2-9682-25dbd8e2160b tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.306779 Nov 08 17:40:56.423388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 223/471] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:56 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:56.666609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c432a178-ae30-4ecb-a4e9-f9ed3dc58e16 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:56.679758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c432a178-ae30-4ecb-a4e9-f9ed3dc58e16 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.311526 Nov 08 17:40:56.681244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 249/472] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:56 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:40:56.958878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0e262bc5-10c7-49d6-b63c-068a71822636 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:56.960453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0e262bc5-10c7-49d6-b63c-068a71822636 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:56.970109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e262bc5-10c7-49d6-b63c-068a71822636 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:56.971140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e262bc5-10c7-49d6-b63c-068a71822636 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:56.973037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e262bc5-10c7-49d6-b63c-068a71822636 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:56.973985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e262bc5-10c7-49d6-b63c-068a71822636 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:57.134441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0e262bc5-10c7-49d6-b63c-068a71822636 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:57.158871 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0e262bc5-10c7-49d6-b63c-068a71822636 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.204407 Nov 08 17:40:57.160400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 224/473] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:56 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:57.167119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:57.168280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:57.175618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:57.176293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:57.177231 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:57.177813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:57.370983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:57.381837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:57.383638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:57.385403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bfbeafc8-69f7-43ec-a820-4943b13577db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1742 microversion: 2.20 time: 0.221777 Nov 08 17:40:57.385968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 250/474] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:57.444571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bb7397dc-96af-4c28-a34e-101f1e7834fd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:57.445212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bb7397dc-96af-4c28-a34e-101f1e7834fd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:57.451719 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb7397dc-96af-4c28-a34e-101f1e7834fd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:57.452239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb7397dc-96af-4c28-a34e-101f1e7834fd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:57.453280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb7397dc-96af-4c28-a34e-101f1e7834fd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:57.453777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb7397dc-96af-4c28-a34e-101f1e7834fd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:57.616974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bb7397dc-96af-4c28-a34e-101f1e7834fd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:57.626331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bb7397dc-96af-4c28-a34e-101f1e7834fd tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.185829 Nov 08 17:40:57.627262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 225/475] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:57 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:57.698165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0f0ba712-f7a7-4c15-b10e-4ecc3a0fcca2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:57.698890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0f0ba712-f7a7-4c15-b10e-4ecc3a0fcca2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:57.704743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f0ba712-f7a7-4c15-b10e-4ecc3a0fcca2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:57.712433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f0ba712-f7a7-4c15-b10e-4ecc3a0fcca2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:57.712433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f0ba712-f7a7-4c15-b10e-4ecc3a0fcca2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:57.712433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f0ba712-f7a7-4c15-b10e-4ecc3a0fcca2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:57.868742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0f0ba712-f7a7-4c15-b10e-4ecc3a0fcca2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:57.875944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0f0ba712-f7a7-4c15-b10e-4ecc3a0fcca2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.181571 Nov 08 17:40:57.884652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 251/476] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:57 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:58.177185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b384e7d9-5ce3-4ea7-9192-76c62e7f651d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:58.178747 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b384e7d9-5ce3-4ea7-9192-76c62e7f651d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:58.186630 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b384e7d9-5ce3-4ea7-9192-76c62e7f651d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.187181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b384e7d9-5ce3-4ea7-9192-76c62e7f651d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.188358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b384e7d9-5ce3-4ea7-9192-76c62e7f651d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.189041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b384e7d9-5ce3-4ea7-9192-76c62e7f651d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.414072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:58.415765 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:58.426632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.429341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.430499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.431799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.451258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b384e7d9-5ce3-4ea7-9192-76c62e7f651d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:58.462316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b384e7d9-5ce3-4ea7-9192-76c62e7f651d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.289836 Nov 08 17:40:58.463113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 226/477] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:58 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:58.604538 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:58.615287 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:58.618550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:58.619718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c600cc53-f365-46ad-b2d3-77307d131038 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1742 microversion: 2.20 time: 0.218507 Nov 08 17:40:58.620598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 252/478] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:40:58.653765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7479b410-5ffc-4909-b288-91da545bba12 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:58.655725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7479b410-5ffc-4909-b288-91da545bba12 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:58.670650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7479b410-5ffc-4909-b288-91da545bba12 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.672467 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7479b410-5ffc-4909-b288-91da545bba12 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.676716 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7479b410-5ffc-4909-b288-91da545bba12 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.679450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7479b410-5ffc-4909-b288-91da545bba12 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.864719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-991e708e-3c93-4871-b81c-5f4c200f60c1 req-8c1a2f90-d3df-41e6-b8ea-64015d849d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf21b3ca-51f1-43c5-9b61-78422c205ff1", "name": "network-vif-plugged", "status": "completed", "tag": "fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:40:58.866436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:40:58.866436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:40:58.873950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-991e708e-3c93-4871-b81c-5f4c200f60c1 req-8c1a2f90-d3df-41e6-b8ea-64015d849d48 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.874382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-991e708e-3c93-4871-b81c-5f4c200f60c1 req-8c1a2f90-d3df-41e6-b8ea-64015d849d48 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.886185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-991e708e-3c93-4871-b81c-5f4c200f60c1 req-8c1a2f90-d3df-41e6-b8ea-64015d849d48 service nova] Creating event network-vif-plugged:fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12 for instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 on hv-cinder-81689 Nov 08 17:40:58.893028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-991e708e-3c93-4871-b81c-5f4c200f60c1 req-8c1a2f90-d3df-41e6-b8ea-64015d849d48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032793 Nov 08 17:40:58.894257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 253/479] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:40:58.900288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-67a79aa9-bb27-4482-a709-2d2b3aad1bde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:58.900913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7479b410-5ffc-4909-b288-91da545bba12 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:58.901091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-67a79aa9-bb27-4482-a709-2d2b3aad1bde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:58.907468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-67a79aa9-bb27-4482-a709-2d2b3aad1bde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.907906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-67a79aa9-bb27-4482-a709-2d2b3aad1bde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.908675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-67a79aa9-bb27-4482-a709-2d2b3aad1bde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:58.909103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-67a79aa9-bb27-4482-a709-2d2b3aad1bde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:58.909875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7479b410-5ffc-4909-b288-91da545bba12 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.266128 Nov 08 17:40:58.910846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 227/480] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:58 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:59.117091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-67a79aa9-bb27-4482-a709-2d2b3aad1bde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:59.130047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-67a79aa9-bb27-4482-a709-2d2b3aad1bde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.233460 Nov 08 17:40:59.130821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 254/481] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:58 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:59.479159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a30250e5-3c7f-4428-b865-1fec4f06aad0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:59.480784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a30250e5-3c7f-4428-b865-1fec4f06aad0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:59.487694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a30250e5-3c7f-4428-b865-1fec4f06aad0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:59.489436 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a30250e5-3c7f-4428-b865-1fec4f06aad0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:59.490717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a30250e5-3c7f-4428-b865-1fec4f06aad0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:59.491455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a30250e5-3c7f-4428-b865-1fec4f06aad0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:59.640157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:59.641526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:59.660555 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:59.666244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:59.667225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:59.668904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:59.688243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a30250e5-3c7f-4428-b865-1fec4f06aad0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:59.705061 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a30250e5-3c7f-4428-b865-1fec4f06aad0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.229658 Nov 08 17:40:59.705967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 228/482] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:59 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:40:59.920280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:59.931974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e78923e3-58f0-4225-a489-99e763c91251 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:40:59.932346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:59.932893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e78923e3-58f0-4225-a489-99e763c91251 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:40:59.933904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:40:59.935395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d935e072-f5f0-44fa-9f18-2fb8f98fef58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.300133 Nov 08 17:40:59.935950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 255/483] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:40:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:40:59.943471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e78923e3-58f0-4225-a489-99e763c91251 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:59.944416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e78923e3-58f0-4225-a489-99e763c91251 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:40:59.945600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e78923e3-58f0-4225-a489-99e763c91251 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:40:59.946579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e78923e3-58f0-4225-a489-99e763c91251 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:00.147330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3893feea-40fd-4a95-87e5-76f60dd91e90 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:00.153022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3893feea-40fd-4a95-87e5-76f60dd91e90 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:00.160080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3893feea-40fd-4a95-87e5-76f60dd91e90 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:00.167831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3893feea-40fd-4a95-87e5-76f60dd91e90 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:00.169044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3893feea-40fd-4a95-87e5-76f60dd91e90 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:00.169795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3893feea-40fd-4a95-87e5-76f60dd91e90 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:00.179414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e78923e3-58f0-4225-a489-99e763c91251 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:00.188651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e78923e3-58f0-4225-a489-99e763c91251 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.265004 Nov 08 17:41:00.204595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 229/484] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:40:59 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:00.396245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3893feea-40fd-4a95-87e5-76f60dd91e90 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:00.408387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3893feea-40fd-4a95-87e5-76f60dd91e90 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.265602 Nov 08 17:41:00.411314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 256/485] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:00 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:00.722854 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-df795c5d-71a1-4046-95b7-427760eab5d2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:00.724821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-df795c5d-71a1-4046-95b7-427760eab5d2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:00.734037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df795c5d-71a1-4046-95b7-427760eab5d2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:00.736422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df795c5d-71a1-4046-95b7-427760eab5d2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:00.737315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df795c5d-71a1-4046-95b7-427760eab5d2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:00.738795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df795c5d-71a1-4046-95b7-427760eab5d2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:00.959273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:00.960337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:00.980932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:00.981514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:00.982489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:00.985331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:01.104506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df795c5d-71a1-4046-95b7-427760eab5d2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:01.113944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-df795c5d-71a1-4046-95b7-427760eab5d2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.394400 Nov 08 17:41:01.125926 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 230/486] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:00 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:01.206409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b2c3064c-ec9e-42a2-ba89-942f56e78cbb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:01.207451 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b2c3064c-ec9e-42a2-ba89-942f56e78cbb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:01.220376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2c3064c-ec9e-42a2-ba89-942f56e78cbb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:01.221184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2c3064c-ec9e-42a2-ba89-942f56e78cbb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:01.223386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2c3064c-ec9e-42a2-ba89-942f56e78cbb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:01.223830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2c3064c-ec9e-42a2-ba89-942f56e78cbb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:01.406312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:01.418450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:01.427838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:01.429071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4a9fdf92-d664-40ee-9c68-8a27f409c641 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.474321 Nov 08 17:41:01.434597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 257/487] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:01.439294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-338c3e1b-9978-4825-a861-305e4b62e013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:01.440660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-338c3e1b-9978-4825-a861-305e4b62e013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:01.447090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-338c3e1b-9978-4825-a861-305e4b62e013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:01.451016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-338c3e1b-9978-4825-a861-305e4b62e013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:01.451016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-338c3e1b-9978-4825-a861-305e4b62e013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:01.451016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-338c3e1b-9978-4825-a861-305e4b62e013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:01.563263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b2c3064c-ec9e-42a2-ba89-942f56e78cbb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:01.594116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b2c3064c-ec9e-42a2-ba89-942f56e78cbb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.391590 Nov 08 17:41:01.599805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 231/488] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:01 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:01.856401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-338c3e1b-9978-4825-a861-305e4b62e013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:01.865299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-338c3e1b-9978-4825-a861-305e4b62e013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1723 microversion: 2.1 time: 0.429377 Nov 08 17:41:01.866086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 258/489] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:01 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:02.131705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3c419d0f-04c9-48c0-866d-7a1fa922f74d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:02.133495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3c419d0f-04c9-48c0-866d-7a1fa922f74d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:02.146545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c419d0f-04c9-48c0-866d-7a1fa922f74d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:02.147337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c419d0f-04c9-48c0-866d-7a1fa922f74d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:02.148324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c419d0f-04c9-48c0-866d-7a1fa922f74d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:02.149163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c419d0f-04c9-48c0-866d-7a1fa922f74d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:02.376752 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3c419d0f-04c9-48c0-866d-7a1fa922f74d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:02.388083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3c419d0f-04c9-48c0-866d-7a1fa922f74d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.258129 Nov 08 17:41:02.389865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 232/490] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:02 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:02.447654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:02.448939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:02.463589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:02.464374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:02.465371 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:02.466275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:02.618863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cd7b37b7-97fe-479b-9d97-8d3ad3c0ec4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:02.620726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cd7b37b7-97fe-479b-9d97-8d3ad3c0ec4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:02.634979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cd7b37b7-97fe-479b-9d97-8d3ad3c0ec4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:02.635632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cd7b37b7-97fe-479b-9d97-8d3ad3c0ec4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:02.636727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cd7b37b7-97fe-479b-9d97-8d3ad3c0ec4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:02.637335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cd7b37b7-97fe-479b-9d97-8d3ad3c0ec4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:02.806365 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:02.818939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:02.820485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:02.821661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-110a1312-656b-4e95-8e20-994b60182f17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.378113 Nov 08 17:41:02.822219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 259/491] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:02.884513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2def2652-4d27-4484-bf53-ac1d755b1971 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:02.885399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2def2652-4d27-4484-bf53-ac1d755b1971 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:02.902891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2def2652-4d27-4484-bf53-ac1d755b1971 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:02.905383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2def2652-4d27-4484-bf53-ac1d755b1971 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:02.906259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2def2652-4d27-4484-bf53-ac1d755b1971 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:02.906721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2def2652-4d27-4484-bf53-ac1d755b1971 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:02.948213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cd7b37b7-97fe-479b-9d97-8d3ad3c0ec4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:02.954840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cd7b37b7-97fe-479b-9d97-8d3ad3c0ec4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.340900 Nov 08 17:41:02.955428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 233/492] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:02 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:03.111579 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2def2652-4d27-4484-bf53-ac1d755b1971 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:03.122522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2def2652-4d27-4484-bf53-ac1d755b1971 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1700 microversion: 2.1 time: 0.242984 Nov 08 17:41:03.123121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 260/493] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:02 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1700 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:03.143376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5e4fe011-bfec-4d2b-9481-4963a465ba4c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:03.150557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e4fe011-bfec-4d2b-9481-4963a465ba4c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:03.151012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e4fe011-bfec-4d2b-9481-4963a465ba4c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:03.217502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5e4fe011-bfec-4d2b-9481-4963a465ba4c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Going to try to start instance {{(pid=127763) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 08 17:41:03.399237 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5e4fe011-bfec-4d2b-9481-4963a465ba4c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 202 len: 0 microversion: 2.1 time: 0.259385 Nov 08 17:41:03.402674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 234/494] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:41:03 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:41:03.410897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9476a0e8-c841-4460-b02b-83740bccb03a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:03.411582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9476a0e8-c841-4460-b02b-83740bccb03a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:03.416180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-42dcaa26-270a-4af7-8810-d2c399621d56 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:03.428875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-42dcaa26-270a-4af7-8810-d2c399621d56 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:03.429234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9476a0e8-c841-4460-b02b-83740bccb03a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:03.429689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9476a0e8-c841-4460-b02b-83740bccb03a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:03.430522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9476a0e8-c841-4460-b02b-83740bccb03a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:03.436122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9476a0e8-c841-4460-b02b-83740bccb03a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:03.437572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-42dcaa26-270a-4af7-8810-d2c399621d56 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:03.437572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-42dcaa26-270a-4af7-8810-d2c399621d56 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:03.437999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-42dcaa26-270a-4af7-8810-d2c399621d56 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:03.438559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-42dcaa26-270a-4af7-8810-d2c399621d56 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:03.926534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9476a0e8-c841-4460-b02b-83740bccb03a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:03.936681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9476a0e8-c841-4460-b02b-83740bccb03a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.533023 Nov 08 17:41:03.950593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 261/495] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:03 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:03.972539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:03.975403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:03.975758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-42dcaa26-270a-4af7-8810-d2c399621d56 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:03.988725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-42dcaa26-270a-4af7-8810-d2c399621d56 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1709 microversion: 2.1 time: 0.584226 Nov 08 17:41:03.989219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 235/496] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:03 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1709 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:03.998049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:04.011034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:04.012029 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:04.012466 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:04.025516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-323e4d7a-32a2-450e-b006-df73b5a1404a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:04.026231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-323e4d7a-32a2-450e-b006-df73b5a1404a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:04.045705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-323e4d7a-32a2-450e-b006-df73b5a1404a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:04.046151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-323e4d7a-32a2-450e-b006-df73b5a1404a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:04.050869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-323e4d7a-32a2-450e-b006-df73b5a1404a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:04.054805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-323e4d7a-32a2-450e-b006-df73b5a1404a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:04.522238 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:04.526518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-323e4d7a-32a2-450e-b006-df73b5a1404a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:04.528442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:04.530151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:04.540458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-323e4d7a-32a2-450e-b006-df73b5a1404a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.532200 Nov 08 17:41:04.544442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 236/497] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:03 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:04.555659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-95513bf3-8528-4778-aae7-c8c252e9c8b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.603609 Nov 08 17:41:04.563755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 262/498] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:04.953626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fd73860a-d1d0-44ba-84c5-e0d4f93ed82f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:04.954391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fd73860a-d1d0-44ba-84c5-e0d4f93ed82f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:04.963347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd73860a-d1d0-44ba-84c5-e0d4f93ed82f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:04.965561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd73860a-d1d0-44ba-84c5-e0d4f93ed82f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.014655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd73860a-d1d0-44ba-84c5-e0d4f93ed82f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:05.014655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd73860a-d1d0-44ba-84c5-e0d4f93ed82f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.020428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-89c1e3c9-711a-4845-b753-03c0341e1b22 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:05.022292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-89c1e3c9-711a-4845-b753-03c0341e1b22 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:05.034215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-89c1e3c9-711a-4845-b753-03c0341e1b22 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:05.039575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-89c1e3c9-711a-4845-b753-03c0341e1b22 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.040891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-89c1e3c9-711a-4845-b753-03c0341e1b22 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:05.041481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-89c1e3c9-711a-4845-b753-03c0341e1b22 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.408593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fd73860a-d1d0-44ba-84c5-e0d4f93ed82f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:05.417356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-89c1e3c9-711a-4845-b753-03c0341e1b22 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:05.418127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fd73860a-d1d0-44ba-84c5-e0d4f93ed82f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.468495 Nov 08 17:41:05.435189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 237/499] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:04 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:05.440782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-0d720b7c-0101-42c7-ba96-f40c9e3d218f req-49510168-e3ce-4ae6-8bec-68a7d8af4d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1b9538-1890-433c-9a61-e95fa423b0ed", "name": "network-vif-plugged", "status": "completed", "tag": "d6088382-accd-47df-bbc8-f5b6496f749e"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:05.442954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:41:05.442954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:41:05.443577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-89c1e3c9-711a-4845-b753-03c0341e1b22 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1709 microversion: 2.1 time: 0.439873 Nov 08 17:41:05.444635 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 263/500] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:05 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1709 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:05.453130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-0d720b7c-0101-42c7-ba96-f40c9e3d218f req-49510168-e3ce-4ae6-8bec-68a7d8af4d2b service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:05.453564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-0d720b7c-0101-42c7-ba96-f40c9e3d218f req-49510168-e3ce-4ae6-8bec-68a7d8af4d2b service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.467967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-0d720b7c-0101-42c7-ba96-f40c9e3d218f req-49510168-e3ce-4ae6-8bec-68a7d8af4d2b service nova] Creating event network-vif-plugged:d6088382-accd-47df-bbc8-f5b6496f749e for instance 2e1b9538-1890-433c-9a61-e95fa423b0ed on hv-cinder-81689 Nov 08 17:41:05.474203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-0d720b7c-0101-42c7-ba96-f40c9e3d218f req-49510168-e3ce-4ae6-8bec-68a7d8af4d2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037250 Nov 08 17:41:05.474873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 238/501] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:41:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:41:05.565441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2aa24c2e-7442-4337-8ecb-472ae96a5206 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:05.568484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2aa24c2e-7442-4337-8ecb-472ae96a5206 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:05.589490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2aa24c2e-7442-4337-8ecb-472ae96a5206 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:05.590169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2aa24c2e-7442-4337-8ecb-472ae96a5206 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.591023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:05.592586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2aa24c2e-7442-4337-8ecb-472ae96a5206 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:05.595277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:05.595431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2aa24c2e-7442-4337-8ecb-472ae96a5206 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.622685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:05.629505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.632518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:05.634163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:05.971582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2aa24c2e-7442-4337-8ecb-472ae96a5206 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:05.977337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2aa24c2e-7442-4337-8ecb-472ae96a5206 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.420147 Nov 08 17:41:05.977926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 264/502] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:05 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:06.078234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:06.091971 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:06.094600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:06.102085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a843349c-2881-450b-a3e9-ab01ad02fac6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.524262 Nov 08 17:41:06.106010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 239/503] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:06.439253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1b1cef87-34d1-4802-ab28-33c35f4b2c84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:06.439822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1b1cef87-34d1-4802-ab28-33c35f4b2c84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:06.456352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b1cef87-34d1-4802-ab28-33c35f4b2c84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:06.458395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b1cef87-34d1-4802-ab28-33c35f4b2c84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:06.463289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b1cef87-34d1-4802-ab28-33c35f4b2c84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:06.463289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b1cef87-34d1-4802-ab28-33c35f4b2c84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:06.463517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b48893d9-0f36-4ba5-90e8-8a79341b6635 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:06.463950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b48893d9-0f36-4ba5-90e8-8a79341b6635 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:06.470731 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b48893d9-0f36-4ba5-90e8-8a79341b6635 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:06.471561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b48893d9-0f36-4ba5-90e8-8a79341b6635 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:06.472797 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b48893d9-0f36-4ba5-90e8-8a79341b6635 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:06.473436 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b48893d9-0f36-4ba5-90e8-8a79341b6635 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:06.795970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1b1cef87-34d1-4802-ab28-33c35f4b2c84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:06.808542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1b1cef87-34d1-4802-ab28-33c35f4b2c84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.372945 Nov 08 17:41:06.809142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 265/504] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:06 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:06.888867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b48893d9-0f36-4ba5-90e8-8a79341b6635 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:06.903395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b48893d9-0f36-4ba5-90e8-8a79341b6635 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1713 microversion: 2.1 time: 0.439360 Nov 08 17:41:06.930899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 240/505] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:06 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1713 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:06.996459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f3f6082a-95ff-4f85-83ba-90c42a726bdb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:06.997442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f3f6082a-95ff-4f85-83ba-90c42a726bdb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:07.004934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3f6082a-95ff-4f85-83ba-90c42a726bdb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:07.005603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3f6082a-95ff-4f85-83ba-90c42a726bdb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:07.007949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3f6082a-95ff-4f85-83ba-90c42a726bdb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:07.008860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3f6082a-95ff-4f85-83ba-90c42a726bdb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:07.121372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:07.122361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:07.129885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:07.131691 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:07.136032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:07.136822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:07.356771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f3f6082a-95ff-4f85-83ba-90c42a726bdb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:07.370937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f3f6082a-95ff-4f85-83ba-90c42a726bdb tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1318 microversion: 2.1 time: 0.380352 Nov 08 17:41:07.372097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 266/506] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:06 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:07.494751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:07.502868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:07.505514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:07.521148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-13632488-a288-4361-aa98-06bed4a78550 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.403558 Nov 08 17:41:07.521801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 241/507] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:07.827865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-88a4ddf6-1bfc-4d8d-8af1-93b1509728b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:07.829333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-88a4ddf6-1bfc-4d8d-8af1-93b1509728b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:07.839077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-88a4ddf6-1bfc-4d8d-8af1-93b1509728b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:07.839937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-88a4ddf6-1bfc-4d8d-8af1-93b1509728b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:07.841590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-88a4ddf6-1bfc-4d8d-8af1-93b1509728b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:07.842574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-88a4ddf6-1bfc-4d8d-8af1-93b1509728b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:08.044967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-88a4ddf6-1bfc-4d8d-8af1-93b1509728b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:08.052959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-88a4ddf6-1bfc-4d8d-8af1-93b1509728b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.229796 Nov 08 17:41:08.053738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 267/508] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:07 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:08.394860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-73e546ae-b3b8-4f93-8dc1-5689ec1cb23c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:08.396077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-73e546ae-b3b8-4f93-8dc1-5689ec1cb23c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:08.407603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73e546ae-b3b8-4f93-8dc1-5689ec1cb23c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:08.408180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73e546ae-b3b8-4f93-8dc1-5689ec1cb23c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:08.414334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73e546ae-b3b8-4f93-8dc1-5689ec1cb23c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:08.415562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73e546ae-b3b8-4f93-8dc1-5689ec1cb23c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:08.540194 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:08.540800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:08.552708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:08.553158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:08.556076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:08.556678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:08.778746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-73e546ae-b3b8-4f93-8dc1-5689ec1cb23c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:08.787292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-73e546ae-b3b8-4f93-8dc1-5689ec1cb23c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1509 microversion: 2.1 time: 0.397908 Nov 08 17:41:08.804568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 242/509] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:08 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:08.981102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:09.005822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:09.011552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:09.020108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7e5c8656-14b5-48f1-9d20-a446396b4dd6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.476598 Nov 08 17:41:09.022346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 268/510] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:09.069614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d2f7975e-46d2-4d57-91eb-9e0f0c5c1e72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:09.070483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d2f7975e-46d2-4d57-91eb-9e0f0c5c1e72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:09.077066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2f7975e-46d2-4d57-91eb-9e0f0c5c1e72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:09.077891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2f7975e-46d2-4d57-91eb-9e0f0c5c1e72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:09.078881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2f7975e-46d2-4d57-91eb-9e0f0c5c1e72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:09.079470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2f7975e-46d2-4d57-91eb-9e0f0c5c1e72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:09.373201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d2f7975e-46d2-4d57-91eb-9e0f0c5c1e72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:09.383450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d2f7975e-46d2-4d57-91eb-9e0f0c5c1e72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.317794 Nov 08 17:41:09.389868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 243/511] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:09 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:10.040817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:10.041462 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:10.047809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:10.048359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:10.049361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:10.050534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:10.223766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:10.241970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:10.243972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:10.245750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-94fd7a28-e1ad-4adb-b8f8-92c987d5ee58 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.210402 Nov 08 17:41:10.246537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 269/512] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:10.400630 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8813b7db-5349-46be-9782-29d38e367be6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:10.401904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8813b7db-5349-46be-9782-29d38e367be6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:10.416513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8813b7db-5349-46be-9782-29d38e367be6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:10.417163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8813b7db-5349-46be-9782-29d38e367be6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:10.418266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8813b7db-5349-46be-9782-29d38e367be6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:10.418911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8813b7db-5349-46be-9782-29d38e367be6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:10.721101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8813b7db-5349-46be-9782-29d38e367be6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:10.731855 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e7eed0a6-5658-4b77-95f0-b1623445a98f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "475ca383-2a7c-4dcb-b840-8fdbe9e6ec41"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:10.735398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8813b7db-5349-46be-9782-29d38e367be6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.338403 Nov 08 17:41:10.736255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 244/513] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:10 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:10.739378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e7eed0a6-5658-4b77-95f0-b1623445a98f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:10.760157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7eed0a6-5658-4b77-95f0-b1623445a98f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:10.762540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7eed0a6-5658-4b77-95f0-b1623445a98f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:10.765117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7eed0a6-5658-4b77-95f0-b1623445a98f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:10.766570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7eed0a6-5658-4b77-95f0-b1623445a98f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:11.265104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:11.265761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:11.278967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:11.279571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:11.280373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:11.280806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:11.535172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:11.545263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:11.547932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:11.554355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ca1bf0be-5382-4c9e-ae44-88822f87965e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.291070 Nov 08 17:41:11.559334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 245/514] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:11.757356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dead3556-07ef-4635-b57d-0707bf290b03 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:11.758721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dead3556-07ef-4635-b57d-0707bf290b03 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:11.772060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dead3556-07ef-4635-b57d-0707bf290b03 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:11.772881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dead3556-07ef-4635-b57d-0707bf290b03 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:11.773957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dead3556-07ef-4635-b57d-0707bf290b03 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:11.774704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dead3556-07ef-4635-b57d-0707bf290b03 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:11.790040 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e7eed0a6-5658-4b77-95f0-b1623445a98f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "POST /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.070442 Nov 08 17:41:11.791425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 270/515] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:41:10 2021] POST /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments => generated 194 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:41:12.138158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dead3556-07ef-4635-b57d-0707bf290b03 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:12.148465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dead3556-07ef-4635-b57d-0707bf290b03 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.397985 Nov 08 17:41:12.158172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 246/516] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:11 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:12.574760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:12.575861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:12.595993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:12.601298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:12.604547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:12.609455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:12.973356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:12.989812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:12.993312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:12.995894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-02e2e623-b59d-4553-8abc-f22b2f07bfb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.426435 Nov 08 17:41:12.997434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 271/517] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:13.168259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-055bdac5-42aa-4a0b-99ad-3c2b0942b651 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:13.169432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-055bdac5-42aa-4a0b-99ad-3c2b0942b651 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:13.179136 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-055bdac5-42aa-4a0b-99ad-3c2b0942b651 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:13.180070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-055bdac5-42aa-4a0b-99ad-3c2b0942b651 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:13.181014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-055bdac5-42aa-4a0b-99ad-3c2b0942b651 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:13.181590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-055bdac5-42aa-4a0b-99ad-3c2b0942b651 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:13.485692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-055bdac5-42aa-4a0b-99ad-3c2b0942b651 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:13.500966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-055bdac5-42aa-4a0b-99ad-3c2b0942b651 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.336199 Nov 08 17:41:13.502210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 247/518] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:13 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:14.018508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:14.019106 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:14.029173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:14.031606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:14.032685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:14.033333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:14.256525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:14.276218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:14.289634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:14.289634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3063c082-f70c-473a-b7d5-8e6fea483737 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.274054 Nov 08 17:41:14.289634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 272/519] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:14.519326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7ba21173-0837-40e9-a66d-08e0b23ba8d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:14.520009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7ba21173-0837-40e9-a66d-08e0b23ba8d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:14.526328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ba21173-0837-40e9-a66d-08e0b23ba8d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:14.526801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ba21173-0837-40e9-a66d-08e0b23ba8d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:14.527760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ba21173-0837-40e9-a66d-08e0b23ba8d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:14.528349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ba21173-0837-40e9-a66d-08e0b23ba8d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:14.730193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7ba21173-0837-40e9-a66d-08e0b23ba8d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:14.739267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7ba21173-0837-40e9-a66d-08e0b23ba8d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.224504 Nov 08 17:41:14.740049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 248/520] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:14 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:15.313098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:15.318300 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:15.334766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:15.335395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:15.336428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:15.339250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:15.595921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:15.605280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:15.606833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:15.608074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-326f4fdb-629f-43a3-aace-9b14ed39e0a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.306013 Nov 08 17:41:15.608642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 273/521] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:15.759223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-14428fa3-62c6-4200-a1c6-1468063bbec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:15.761051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-14428fa3-62c6-4200-a1c6-1468063bbec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:15.769914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14428fa3-62c6-4200-a1c6-1468063bbec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:15.771431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14428fa3-62c6-4200-a1c6-1468063bbec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:15.786687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14428fa3-62c6-4200-a1c6-1468063bbec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:15.789378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14428fa3-62c6-4200-a1c6-1468063bbec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:15.972866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-14428fa3-62c6-4200-a1c6-1468063bbec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:15.981092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-14428fa3-62c6-4200-a1c6-1468063bbec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.226000 Nov 08 17:41:15.981655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 249/522] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:15 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:16.630521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:16.631178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:16.648124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:16.654016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:16.654016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:16.654016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:16.832012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:16.841942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:16.843760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:16.844994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1de6237f-6f79-4cd0-af39-33879919c433 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.220274 Nov 08 17:41:16.846312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 274/523] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:17.004699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ef2d3821-e51a-45fe-9cff-f5c55b5367ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:17.005701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ef2d3821-e51a-45fe-9cff-f5c55b5367ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:17.013219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef2d3821-e51a-45fe-9cff-f5c55b5367ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:17.013697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef2d3821-e51a-45fe-9cff-f5c55b5367ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:17.014673 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef2d3821-e51a-45fe-9cff-f5c55b5367ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:17.015203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef2d3821-e51a-45fe-9cff-f5c55b5367ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:17.504386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ef2d3821-e51a-45fe-9cff-f5c55b5367ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:17.512554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ef2d3821-e51a-45fe-9cff-f5c55b5367ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.512695 Nov 08 17:41:17.513135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 250/524] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:16 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:17.864654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:17.865307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:17.881021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:17.881021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:17.881021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:17.881021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:18.027369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:18.037671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:18.040454 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:18.042748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-17e95f8a-8a62-4790-9ac4-98206a66a8f7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.181640 Nov 08 17:41:18.048143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 275/525] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:18.528880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e22b3508-4acd-4643-adf7-9762cc64cc36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:18.529481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e22b3508-4acd-4643-adf7-9762cc64cc36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:18.536814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e22b3508-4acd-4643-adf7-9762cc64cc36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:18.537251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e22b3508-4acd-4643-adf7-9762cc64cc36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:18.538013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e22b3508-4acd-4643-adf7-9762cc64cc36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:18.538445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e22b3508-4acd-4643-adf7-9762cc64cc36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:18.675689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e22b3508-4acd-4643-adf7-9762cc64cc36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:18.679732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e22b3508-4acd-4643-adf7-9762cc64cc36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.154477 Nov 08 17:41:18.680617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 251/526] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:18 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:19.061771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:19.062549 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:19.068881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:19.069324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:19.070093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:19.070550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:19.195790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:19.203777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:19.205293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:19.207041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b2ce754b-515d-47f1-b612-f7f04a182a38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1737 microversion: 2.20 time: 0.149063 Nov 08 17:41:19.207610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 276/527] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:19.696596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-579bdd63-5ec5-4207-9290-19824ddd56d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:19.697218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-579bdd63-5ec5-4207-9290-19824ddd56d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:19.703452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-579bdd63-5ec5-4207-9290-19824ddd56d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:19.703897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-579bdd63-5ec5-4207-9290-19824ddd56d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:19.704665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-579bdd63-5ec5-4207-9290-19824ddd56d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:19.705092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-579bdd63-5ec5-4207-9290-19824ddd56d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:19.835422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-579bdd63-5ec5-4207-9290-19824ddd56d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:19.845242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-579bdd63-5ec5-4207-9290-19824ddd56d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.152129 Nov 08 17:41:19.846599 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 252/528] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:19 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:20.227392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:20.228014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:20.234384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:20.235050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:20.236044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:20.236789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:20.380302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:20.392844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:20.395177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:20.396542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b0afd730-4d13-45b6-902e-27e6c1b8dfe3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1719 microversion: 2.20 time: 0.172761 Nov 08 17:41:20.396913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 277/529] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:20.855839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1223311176", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "networks": [{"uuid": "73411eba-2509-47eb-96c4-003b08519b6d"}]}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:20.862263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-97ae6c8d-5c04-453d-b214-10485275563c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:20.862972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-97ae6c8d-5c04-453d-b214-10485275563c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:20.869051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97ae6c8d-5c04-453d-b214-10485275563c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:20.869567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97ae6c8d-5c04-453d-b214-10485275563c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:20.870402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97ae6c8d-5c04-453d-b214-10485275563c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:20.870950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97ae6c8d-5c04-453d-b214-10485275563c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:20.930058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] validate_networks() for [('73411eba-2509-47eb-96c4-003b08519b6d', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:41:21.098932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-97ae6c8d-5c04-453d-b214-10485275563c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:21.106581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-97ae6c8d-5c04-453d-b214-10485275563c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.248028 Nov 08 17:41:21.107163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 278/530] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:20 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:21.317838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:41:21.318250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:41:21.318815 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:41:21.319240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:41:21.319639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:41:21.328111 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:21.328555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:21.329348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:21.329768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:21.346090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Getting quotas for project 27ba6928417b4b3bb1e4222ed1a7b3dd. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:41:21.350069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Getting quotas for user 5340065597ba44f9b9798a5fcb5fe411 and project 27ba6928417b4b3bb1e4222ed1a7b3dd. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:41:21.360492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:41:21.363446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:41:21.414554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:21.415194 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:21.421352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:21.421793 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:21.422573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:21.423037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:21.512176 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fa35985c-4236-49e0-8bfa-41fdafbebcbc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659862 Nov 08 17:41:21.512876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 253/531] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:41:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:41:21.523465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-45aa94f2-6d97-4439-90af-8e43ae113859 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:21.524074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-45aa94f2-6d97-4439-90af-8e43ae113859 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:21.577137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:21.591342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-45aa94f2-6d97-4439-90af-8e43ae113859 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:21.594677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:21.597308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:21.598934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-45aa94f2-6d97-4439-90af-8e43ae113859 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1219 microversion: 2.1 time: 0.079751 Nov 08 17:41:21.599936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 254/532] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:21 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:21.600641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e6165815-f621-4b0e-8f61-fffca58e210c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1719 microversion: 2.20 time: 0.189268 Nov 08 17:41:21.601327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 279/533] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:22.122938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aa0d98d5-71ff-4c8c-9f86-76ee9a35ca24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:22.123623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aa0d98d5-71ff-4c8c-9f86-76ee9a35ca24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:22.131278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa0d98d5-71ff-4c8c-9f86-76ee9a35ca24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:22.131729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa0d98d5-71ff-4c8c-9f86-76ee9a35ca24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:22.132502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa0d98d5-71ff-4c8c-9f86-76ee9a35ca24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:22.132939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa0d98d5-71ff-4c8c-9f86-76ee9a35ca24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:22.266753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-aa0d98d5-71ff-4c8c-9f86-76ee9a35ca24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:22.274975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aa0d98d5-71ff-4c8c-9f86-76ee9a35ca24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.155655 Nov 08 17:41:22.275551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 255/534] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:22 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:22.616409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ad9472d5-c375-438b-9117-55f5a999e908 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:22.617040 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ad9472d5-c375-438b-9117-55f5a999e908 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:22.618051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:22.618696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:22.624513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:22.625063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:22.625888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:22.626323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:22.672297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ad9472d5-c375-438b-9117-55f5a999e908 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:22.682108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ad9472d5-c375-438b-9117-55f5a999e908 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1219 microversion: 2.1 time: 0.068440 Nov 08 17:41:22.689196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 280/535] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:22 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:22.770666 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:22.778636 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:22.780108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:22.781271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a19d5b5c-aa9d-446b-b144-26f3e93d6eb2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1719 microversion: 2.20 time: 0.167104 Nov 08 17:41:22.781826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 256/536] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:23.291746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8db2e4ac-a699-4bb5-b14b-5a2d180e546e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:23.292305 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8db2e4ac-a699-4bb5-b14b-5a2d180e546e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:23.298170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8db2e4ac-a699-4bb5-b14b-5a2d180e546e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.298653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8db2e4ac-a699-4bb5-b14b-5a2d180e546e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.299440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8db2e4ac-a699-4bb5-b14b-5a2d180e546e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.299866 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8db2e4ac-a699-4bb5-b14b-5a2d180e546e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.431394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8db2e4ac-a699-4bb5-b14b-5a2d180e546e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:23.438904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8db2e4ac-a699-4bb5-b14b-5a2d180e546e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.150815 Nov 08 17:41:23.439480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 281/537] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:23 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:23.594650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-c38e283f-e2b2-46f2-bbe5-4398c9f43eee req-f58882d9-d66e-4c15-9989-12edd15343ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf21b3ca-51f1-43c5-9b61-78422c205ff1", "name": "network-vif-unplugged", "status": "completed", "tag": "fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:23.596352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:41:23.596352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:41:23.603631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-c38e283f-e2b2-46f2-bbe5-4398c9f43eee req-f58882d9-d66e-4c15-9989-12edd15343ff service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.604073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-c38e283f-e2b2-46f2-bbe5-4398c9f43eee req-f58882d9-d66e-4c15-9989-12edd15343ff service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.615661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-c38e283f-e2b2-46f2-bbe5-4398c9f43eee req-f58882d9-d66e-4c15-9989-12edd15343ff service nova] Creating event network-vif-unplugged:fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12 for instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 on hv-cinder-81689 Nov 08 17:41:23.622114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-c38e283f-e2b2-46f2-bbe5-4398c9f43eee req-f58882d9-d66e-4c15-9989-12edd15343ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030628 Nov 08 17:41:23.622485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 257/538] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:41:23 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:41:23.697098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1d56ddde-07e4-4aa8-a711-8c69bb1a1d35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:23.697791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1d56ddde-07e4-4aa8-a711-8c69bb1a1d35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:23.704403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d56ddde-07e4-4aa8-a711-8c69bb1a1d35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.705032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d56ddde-07e4-4aa8-a711-8c69bb1a1d35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.706184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d56ddde-07e4-4aa8-a711-8c69bb1a1d35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.706641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d56ddde-07e4-4aa8-a711-8c69bb1a1d35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.775713 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1d56ddde-07e4-4aa8-a711-8c69bb1a1d35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:23.786130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1d56ddde-07e4-4aa8-a711-8c69bb1a1d35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1223 microversion: 2.1 time: 0.092779 Nov 08 17:41:23.790504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 282/539] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:23 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:23.799960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:23.800664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:23.807004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.811103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.812544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.813095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.932789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-83434f8a-5b52-460e-b295-8361f47b30a7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:23.934073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-83434f8a-5b52-460e-b295-8361f47b30a7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:23.941160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83434f8a-5b52-460e-b295-8361f47b30a7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.941755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83434f8a-5b52-460e-b295-8361f47b30a7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.942879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83434f8a-5b52-460e-b295-8361f47b30a7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:23.943399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83434f8a-5b52-460e-b295-8361f47b30a7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:23.995677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:24.007197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:24.008778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:24.009948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c1d012d2-9616-42a0-8c51-9b61548bd619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1719 microversion: 2.20 time: 0.214587 Nov 08 17:41:24.010530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 258/540] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:24.031512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-83434f8a-5b52-460e-b295-8361f47b30a7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lazy-loading 'services' on Instance uuid 2e1b9538-1890-433c-9a61-e95fa423b0ed {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:41:24.286690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-83434f8a-5b52-460e-b295-8361f47b30a7 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments/475ca383-2a7c-4dcb-b840-8fdbe9e6ec41" status: 202 len: 0 microversion: 2.1 time: 0.358273 Nov 08 17:41:24.287276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 283/541] 10.222.0.18 () {58 vars in 1415 bytes} [Mon Nov 8 17:41:23 2021] DELETE /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments/475ca383-2a7c-4dcb-b840-8fdbe9e6ec41 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:41:24.295330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-15204598-e24c-4af7-b736-8f58eba62d4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:24.296515 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-15204598-e24c-4af7-b736-8f58eba62d4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:24.303043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15204598-e24c-4af7-b736-8f58eba62d4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:24.303483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15204598-e24c-4af7-b736-8f58eba62d4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:24.304238 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15204598-e24c-4af7-b736-8f58eba62d4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:24.304671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15204598-e24c-4af7-b736-8f58eba62d4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:24.334408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-15204598-e24c-4af7-b736-8f58eba62d4c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042735 Nov 08 17:41:24.334990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 259/542] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:41:24 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:41:24.457432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-09288be5-cdf2-4759-af32-4f0412d8d21e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:24.458035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-09288be5-cdf2-4759-af32-4f0412d8d21e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:24.464348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09288be5-cdf2-4759-af32-4f0412d8d21e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:24.464787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09288be5-cdf2-4759-af32-4f0412d8d21e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:24.466409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09288be5-cdf2-4759-af32-4f0412d8d21e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:24.466409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09288be5-cdf2-4759-af32-4f0412d8d21e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:24.707188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-09288be5-cdf2-4759-af32-4f0412d8d21e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:24.714139 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-09288be5-cdf2-4759-af32-4f0412d8d21e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.261391 Nov 08 17:41:24.714999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 284/543] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:24 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:24.805243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-619d6ab2-8e58-4e5a-9ba5-c73945e9d6c2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:24.806603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-619d6ab2-8e58-4e5a-9ba5-c73945e9d6c2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:24.812613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-619d6ab2-8e58-4e5a-9ba5-c73945e9d6c2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:24.813232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-619d6ab2-8e58-4e5a-9ba5-c73945e9d6c2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:24.814002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-619d6ab2-8e58-4e5a-9ba5-c73945e9d6c2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:24.814700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-619d6ab2-8e58-4e5a-9ba5-c73945e9d6c2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:24.894269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-619d6ab2-8e58-4e5a-9ba5-c73945e9d6c2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:24.901734 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-619d6ab2-8e58-4e5a-9ba5-c73945e9d6c2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1271 microversion: 2.1 time: 0.100724 Nov 08 17:41:24.902306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 260/544] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:24 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:25.029183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:25.029792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:25.036354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:25.036821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:25.037620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:25.038081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:25.175853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:25.183610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:25.185189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:25.186324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4737d8e3-35a8-406e-b0c9-464919ae3df3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1719 microversion: 2.20 time: 0.160966 Nov 08 17:41:25.186918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 285/545] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:25.344946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-169c4589-214f-4b5b-a610-f9d9f6cf5b9c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:25.346428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-169c4589-214f-4b5b-a610-f9d9f6cf5b9c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:25.352322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-169c4589-214f-4b5b-a610-f9d9f6cf5b9c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:25.352726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-169c4589-214f-4b5b-a610-f9d9f6cf5b9c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:25.353480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-169c4589-214f-4b5b-a610-f9d9f6cf5b9c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:25.353902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-169c4589-214f-4b5b-a610-f9d9f6cf5b9c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:25.383012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-169c4589-214f-4b5b-a610-f9d9f6cf5b9c tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Nov 08 17:41:25.383484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 261/546] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:41:25 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:41:25.731525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-16475dba-b783-4245-b850-9fd026353d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:25.732171 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-16475dba-b783-4245-b850-9fd026353d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:25.738783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-16475dba-b783-4245-b850-9fd026353d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:25.739219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-16475dba-b783-4245-b850-9fd026353d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:25.739984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-16475dba-b783-4245-b850-9fd026353d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:25.740487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-16475dba-b783-4245-b850-9fd026353d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:25.871224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-16475dba-b783-4245-b850-9fd026353d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:25.878695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-16475dba-b783-4245-b850-9fd026353d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.150779 Nov 08 17:41:25.879652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 286/547] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:25 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:25.920848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-77b5fd92-56ea-41e7-a323-b5cdd67797ac tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:25.921461 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-77b5fd92-56ea-41e7-a323-b5cdd67797ac tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:25.928212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-77b5fd92-56ea-41e7-a323-b5cdd67797ac tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:25.928655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-77b5fd92-56ea-41e7-a323-b5cdd67797ac tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:25.929417 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-77b5fd92-56ea-41e7-a323-b5cdd67797ac tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:25.929847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-77b5fd92-56ea-41e7-a323-b5cdd67797ac tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:25.988912 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-77b5fd92-56ea-41e7-a323-b5cdd67797ac tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:25.996435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-77b5fd92-56ea-41e7-a323-b5cdd67797ac tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1279 microversion: 2.1 time: 0.079246 Nov 08 17:41:25.997010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 262/548] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:25 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1279 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:26.204803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:26.205550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:26.211225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:26.211774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:26.212546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:26.212967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:26.343172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:26.351509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:26.352993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:26.354148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-797c3952-d072-4d2a-a4b3-daaf520ad625 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1719 microversion: 2.20 time: 0.153038 Nov 08 17:41:26.354744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 287/549] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:26.394086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4485f8ce-fd01-4436-806a-94fb3e740687 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:26.395097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4485f8ce-fd01-4436-806a-94fb3e740687 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:26.400920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4485f8ce-fd01-4436-806a-94fb3e740687 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:26.401364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4485f8ce-fd01-4436-806a-94fb3e740687 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:26.402128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4485f8ce-fd01-4436-806a-94fb3e740687 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:26.402601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4485f8ce-fd01-4436-806a-94fb3e740687 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:26.430936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4485f8ce-fd01-4436-806a-94fb3e740687 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041280 Nov 08 17:41:26.431491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 263/550] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:41:26 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:41:26.897278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4cf74127-8eed-4109-b801-59a39d99d28b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:26.898500 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4cf74127-8eed-4109-b801-59a39d99d28b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:26.905971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4cf74127-8eed-4109-b801-59a39d99d28b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:26.906638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4cf74127-8eed-4109-b801-59a39d99d28b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:26.907597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4cf74127-8eed-4109-b801-59a39d99d28b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:26.908037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4cf74127-8eed-4109-b801-59a39d99d28b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:27.013894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1780cd98-5702-4ae5-9fa8-e1d5d9bada1a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:27.014529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1780cd98-5702-4ae5-9fa8-e1d5d9bada1a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:27.021719 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1780cd98-5702-4ae5-9fa8-e1d5d9bada1a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:27.022164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1780cd98-5702-4ae5-9fa8-e1d5d9bada1a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:27.022955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1780cd98-5702-4ae5-9fa8-e1d5d9bada1a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:27.023385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1780cd98-5702-4ae5-9fa8-e1d5d9bada1a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:27.058348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4cf74127-8eed-4109-b801-59a39d99d28b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:27.071357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4cf74127-8eed-4109-b801-59a39d99d28b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.178926 Nov 08 17:41:27.072200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 288/551] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:26 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:27.101128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1780cd98-5702-4ae5-9fa8-e1d5d9bada1a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:27.108672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1780cd98-5702-4ae5-9fa8-e1d5d9bada1a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1279 microversion: 2.1 time: 0.098918 Nov 08 17:41:27.109251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 264/552] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:27 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:27.385979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:27.386605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:27.393277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:27.393832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:27.394640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:27.395100 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:27.441830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-41b0bb4e-03af-4458-968a-40fdfc77d6f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:27.442770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-41b0bb4e-03af-4458-968a-40fdfc77d6f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:27.448555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41b0bb4e-03af-4458-968a-40fdfc77d6f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:27.448999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41b0bb4e-03af-4458-968a-40fdfc77d6f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:27.449770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41b0bb4e-03af-4458-968a-40fdfc77d6f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:27.450205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41b0bb4e-03af-4458-968a-40fdfc77d6f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:27.480039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-41b0bb4e-03af-4458-968a-40fdfc77d6f4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Nov 08 17:41:27.480922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 265/553] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:41:27 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:41:27.527834 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:27.535975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:27.537488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:27.538658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b7b09d88-8fa7-4e63-9d8e-3e3bec17efc8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1719 microversion: 2.20 time: 0.156358 Nov 08 17:41:27.539216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 289/554] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:28.088336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-900028cb-30b9-4494-bed2-0d263b87fb91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:28.088941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-900028cb-30b9-4494-bed2-0d263b87fb91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:28.095546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-900028cb-30b9-4494-bed2-0d263b87fb91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:28.096371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-900028cb-30b9-4494-bed2-0d263b87fb91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:28.097152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-900028cb-30b9-4494-bed2-0d263b87fb91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:28.097769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-900028cb-30b9-4494-bed2-0d263b87fb91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:28.126067 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dcfab4fd-d75a-415f-a4d1-74eb6a770ec4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:28.127826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dcfab4fd-d75a-415f-a4d1-74eb6a770ec4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:28.134444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcfab4fd-d75a-415f-a4d1-74eb6a770ec4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:28.135035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcfab4fd-d75a-415f-a4d1-74eb6a770ec4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:28.136386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcfab4fd-d75a-415f-a4d1-74eb6a770ec4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:28.137980 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcfab4fd-d75a-415f-a4d1-74eb6a770ec4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:28.213393 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dcfab4fd-d75a-415f-a4d1-74eb6a770ec4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:28.221964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dcfab4fd-d75a-415f-a4d1-74eb6a770ec4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1277 microversion: 2.1 time: 0.099398 Nov 08 17:41:28.230995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 290/555] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:28 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:28.287309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-900028cb-30b9-4494-bed2-0d263b87fb91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:28.294505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-900028cb-30b9-4494-bed2-0d263b87fb91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1523 microversion: 2.1 time: 0.209843 Nov 08 17:41:28.295088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 266/556] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:28 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:28.492018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d2d72173-832b-4bdf-a89d-b8fabf4b1af6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:28.493142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d2d72173-832b-4bdf-a89d-b8fabf4b1af6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:28.500378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2d72173-832b-4bdf-a89d-b8fabf4b1af6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:28.500821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2d72173-832b-4bdf-a89d-b8fabf4b1af6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:28.501635 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2d72173-832b-4bdf-a89d-b8fabf4b1af6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:28.502054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2d72173-832b-4bdf-a89d-b8fabf4b1af6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:28.533884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d2d72173-832b-4bdf-a89d-b8fabf4b1af6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Nov 08 17:41:28.534483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 291/557] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:41:28 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:41:28.556713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:28.557577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:28.564189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:28.564682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:28.565509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:28.566127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:28.727452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:28.741830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:28.749598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:28.749598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d029524a-a92b-48b6-b346-f58bbee532c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1719 microversion: 2.20 time: 0.191979 Nov 08 17:41:28.749598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 267/558] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:29.239199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4f4467b0-9950-4def-9ba9-788a18f5e184 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:29.239831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4f4467b0-9950-4def-9ba9-788a18f5e184 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:29.246217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f4467b0-9950-4def-9ba9-788a18f5e184 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.246694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f4467b0-9950-4def-9ba9-788a18f5e184 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.247465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f4467b0-9950-4def-9ba9-788a18f5e184 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.252999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f4467b0-9950-4def-9ba9-788a18f5e184 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.314067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-16f6cc7d-024e-4066-8ae7-0cd3102f8514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:29.315229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-16f6cc7d-024e-4066-8ae7-0cd3102f8514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:29.322850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16f6cc7d-024e-4066-8ae7-0cd3102f8514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.324873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16f6cc7d-024e-4066-8ae7-0cd3102f8514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.326050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16f6cc7d-024e-4066-8ae7-0cd3102f8514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.326723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16f6cc7d-024e-4066-8ae7-0cd3102f8514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.411046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4f4467b0-9950-4def-9ba9-788a18f5e184 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:29.422898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4f4467b0-9950-4def-9ba9-788a18f5e184 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1319 microversion: 2.1 time: 0.187146 Nov 08 17:41:29.424503 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 292/559] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:29 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:29.530283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-16f6cc7d-024e-4066-8ae7-0cd3102f8514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:29.538896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-16f6cc7d-024e-4066-8ae7-0cd3102f8514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1503 microversion: 2.1 time: 0.230780 Nov 08 17:41:29.539471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 268/560] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:29 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:29.545145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4178a656-51f5-4377-9217-bb01f93f3155 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:29.546047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4178a656-51f5-4377-9217-bb01f93f3155 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:29.551828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4178a656-51f5-4377-9217-bb01f93f3155 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.552278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4178a656-51f5-4377-9217-bb01f93f3155 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.553061 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4178a656-51f5-4377-9217-bb01f93f3155 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.553477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4178a656-51f5-4377-9217-bb01f93f3155 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.558397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4f5ed436-0556-40e6-ae5f-ad59f6dd431d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:29.559303 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4f5ed436-0556-40e6-ae5f-ad59f6dd431d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:29.565601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f5ed436-0556-40e6-ae5f-ad59f6dd431d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.566044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f5ed436-0556-40e6-ae5f-ad59f6dd431d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.566912 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f5ed436-0556-40e6-ae5f-ad59f6dd431d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.567349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f5ed436-0556-40e6-ae5f-ad59f6dd431d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.584142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4178a656-51f5-4377-9217-bb01f93f3155 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042687 Nov 08 17:41:29.584714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 293/561] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:41:29 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:41:29.693009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-e027cb75-8edc-4a28-a80c-093c1ee95327 req-73912440-1630-426f-b943-43e4b6fa0fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6c9295-0da3-43bd-b2fa-5709f1c39dbe", "tag": "a97c62f3-4ad6-47b6-ab5e-55e6bae21f78"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:29.696533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:41:29.696533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:41:29.704278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-e027cb75-8edc-4a28-a80c-093c1ee95327 req-73912440-1630-426f-b943-43e4b6fa0fda service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.704791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-e027cb75-8edc-4a28-a80c-093c1ee95327 req-73912440-1630-426f-b943-43e4b6fa0fda service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.720316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-e027cb75-8edc-4a28-a80c-093c1ee95327 req-73912440-1630-426f-b943-43e4b6fa0fda service nova] Creating event network-changed:a97c62f3-4ad6-47b6-ab5e-55e6bae21f78 for instance 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe on hv-cinder-81689 Nov 08 17:41:29.727313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-e027cb75-8edc-4a28-a80c-093c1ee95327 req-73912440-1630-426f-b943-43e4b6fa0fda service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041136 Nov 08 17:41:29.736210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4f5ed436-0556-40e6-ae5f-ad59f6dd431d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:29.737576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 294/562] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:41:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:41:29.737693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4f5ed436-0556-40e6-ae5f-ad59f6dd431d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1517 microversion: 2.1 time: 0.180883 Nov 08 17:41:29.737693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 269/563] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:29.765168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:29.766070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:29.774232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.774746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.775557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.776135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.940074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:29.949452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:29.950995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:29.952135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-65971c41-419c-410d-8696-d4803559bade tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1722 microversion: 2.20 time: 0.191704 Nov 08 17:41:29.952724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 295/564] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:29.978173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-044319e7-b84d-488c-8803-230ef26f6fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc01a120-8edd-4c4a-94da-0409ed7b64e2"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:29.979354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-044319e7-b84d-488c-8803-230ef26f6fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:29.985476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-044319e7-b84d-488c-8803-230ef26f6fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.985910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-044319e7-b84d-488c-8803-230ef26f6fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:29.986849 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-044319e7-b84d-488c-8803-230ef26f6fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:29.987277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-044319e7-b84d-488c-8803-230ef26f6fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:30.442427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ca5b5dfb-8df0-4cb4-83a3-195d8538b90e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:30.443749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ca5b5dfb-8df0-4cb4-83a3-195d8538b90e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:30.451917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca5b5dfb-8df0-4cb4-83a3-195d8538b90e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:30.452606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca5b5dfb-8df0-4cb4-83a3-195d8538b90e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:30.453543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca5b5dfb-8df0-4cb4-83a3-195d8538b90e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:30.454124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca5b5dfb-8df0-4cb4-83a3-195d8538b90e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:30.622413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ca5b5dfb-8df0-4cb4-83a3-195d8538b90e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:30.623316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ca5b5dfb-8df0-4cb4-83a3-195d8538b90e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1319 microversion: 2.1 time: 0.185637 Nov 08 17:41:30.623909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 296/565] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:30 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:31.009678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9fd7881a-706d-4f45-b13a-c48468d38eab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:31.010175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9fd7881a-706d-4f45-b13a-c48468d38eab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:31.015892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fd7881a-706d-4f45-b13a-c48468d38eab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.016336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fd7881a-706d-4f45-b13a-c48468d38eab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.017098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fd7881a-706d-4f45-b13a-c48468d38eab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.018893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fd7881a-706d-4f45-b13a-c48468d38eab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.040727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9fd7881a-706d-4f45-b13a-c48468d38eab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:41:31.109052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-044319e7-b84d-488c-8803-230ef26f6fe5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.142419 Nov 08 17:41:31.109660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 270/566] 10.222.0.18 () {62 vars in 1363 bytes} [Mon Nov 8 17:41:29 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 188 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:41:31.218709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e7298c2a-5a43-4caf-a5ce-c04e320b3a02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:31.219265 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e7298c2a-5a43-4caf-a5ce-c04e320b3a02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:31.225684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7298c2a-5a43-4caf-a5ce-c04e320b3a02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.226123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7298c2a-5a43-4caf-a5ce-c04e320b3a02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.226928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7298c2a-5a43-4caf-a5ce-c04e320b3a02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.227355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7298c2a-5a43-4caf-a5ce-c04e320b3a02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.412850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9fd7881a-706d-4f45-b13a-c48468d38eab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 204 len: 0 microversion: 2.1 time: 0.406479 Nov 08 17:41:31.413570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 297/567] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:41:31 2021] DELETE /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 08 17:41:31.421211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-40b92018-0918-4696-99dc-71e1b722ebb9 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:31.421892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-40b92018-0918-4696-99dc-71e1b722ebb9 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:31.428309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40b92018-0918-4696-99dc-71e1b722ebb9 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.428745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40b92018-0918-4696-99dc-71e1b722ebb9 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.429509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40b92018-0918-4696-99dc-71e1b722ebb9 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.429941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40b92018-0918-4696-99dc-71e1b722ebb9 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.528418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e7298c2a-5a43-4caf-a5ce-c04e320b3a02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 202 len: 0 microversion: 2.20 time: 0.313452 Nov 08 17:41:31.529191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 271/568] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:41:31 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 08 17:41:31.534698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f4ad979d-84e6-4b66-9853-115a0b58b19d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:31.535884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f4ad979d-84e6-4b66-9853-115a0b58b19d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:31.542832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4ad979d-84e6-4b66-9853-115a0b58b19d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.543270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4ad979d-84e6-4b66-9853-115a0b58b19d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.544044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4ad979d-84e6-4b66-9853-115a0b58b19d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.544470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4ad979d-84e6-4b66-9853-115a0b58b19d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.574880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-f4ad979d-84e6-4b66-9853-115a0b58b19d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lazy-loading 'flavor' on Instance uuid 76806517-5f8b-4d47-89f6-66e876baa194 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:41:31.575745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-40b92018-0918-4696-99dc-71e1b722ebb9 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:31.578054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-40b92018-0918-4696-99dc-71e1b722ebb9 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1515 microversion: 2.1 time: 0.160621 Nov 08 17:41:31.578980 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 298/569] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:31 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:31.583728 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:31.584516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:31.590284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.590753 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.591689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.592124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.728433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:31.736609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:31.738112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:31.739286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3305ebaf-47b4-4442-b0cc-7f9d0acf9551 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1748 microversion: 2.20 time: 0.159332 Nov 08 17:41:31.739840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 299/570] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:31.744556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6be8c87c-76ec-44ba-9580-3c30db48dba3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:31.745321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6be8c87c-76ec-44ba-9580-3c30db48dba3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:31.751224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6be8c87c-76ec-44ba-9580-3c30db48dba3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.752760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6be8c87c-76ec-44ba-9580-3c30db48dba3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.753217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6be8c87c-76ec-44ba-9580-3c30db48dba3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:31.753996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6be8c87c-76ec-44ba-9580-3c30db48dba3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:31.895049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6be8c87c-76ec-44ba-9580-3c30db48dba3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:31.902658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6be8c87c-76ec-44ba-9580-3c30db48dba3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1319 microversion: 2.1 time: 0.161640 Nov 08 17:41:31.903228 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 300/571] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:31 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:31.987779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f4ad979d-84e6-4b66-9853-115a0b58b19d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action" status: 200 len: 32 microversion: 2.1 time: 0.457407 Nov 08 17:41:31.988399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 272/572] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:41:31 2021] POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action => generated 32 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:41:31.998046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d70e84e0-c42f-4f53-b72c-2b5149a40609 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:31.998777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d70e84e0-c42f-4f53-b72c-2b5149a40609 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:32.005227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d70e84e0-c42f-4f53-b72c-2b5149a40609 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:32.005754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d70e84e0-c42f-4f53-b72c-2b5149a40609 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:32.006582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d70e84e0-c42f-4f53-b72c-2b5149a40609 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:32.006998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d70e84e0-c42f-4f53-b72c-2b5149a40609 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:32.143500 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d70e84e0-c42f-4f53-b72c-2b5149a40609 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:32.151071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d70e84e0-c42f-4f53-b72c-2b5149a40609 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.156689 Nov 08 17:41:32.151902 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 301/573] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:32.597613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e0b9a316-989c-4c49-b6ae-197b83ce596a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:32.598563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e0b9a316-989c-4c49-b6ae-197b83ce596a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:32.604566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0b9a316-989c-4c49-b6ae-197b83ce596a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:32.605261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0b9a316-989c-4c49-b6ae-197b83ce596a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:32.606283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0b9a316-989c-4c49-b6ae-197b83ce596a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:32.606840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0b9a316-989c-4c49-b6ae-197b83ce596a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:32.749486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e0b9a316-989c-4c49-b6ae-197b83ce596a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:32.758401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:32.759060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e0b9a316-989c-4c49-b6ae-197b83ce596a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1515 microversion: 2.1 time: 0.166826 Nov 08 17:41:32.759242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:32.759443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 273/574] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:32 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:32.769055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:32.769575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:32.773976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:32.773976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:32.928596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c117ce5f-a102-4317-8110-804602c45cdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:32.928596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c117ce5f-a102-4317-8110-804602c45cdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:32.936331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c117ce5f-a102-4317-8110-804602c45cdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:32.936880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c117ce5f-a102-4317-8110-804602c45cdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:32.937763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c117ce5f-a102-4317-8110-804602c45cdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:32.938373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c117ce5f-a102-4317-8110-804602c45cdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:32.985497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:33.004687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:33.006173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:33.007362 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0af80a92-a71d-4a22-8bee-0e05bc43ab43 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1748 microversion: 2.20 time: 0.252660 Nov 08 17:41:33.008161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 302/575] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1748 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:33.124855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c117ce5f-a102-4317-8110-804602c45cdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:33.128700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c117ce5f-a102-4317-8110-804602c45cdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1319 microversion: 2.1 time: 0.212361 Nov 08 17:41:33.129594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 274/576] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:32 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:33.168588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a8deadaf-704b-42f1-b955-aed9a444050e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:33.169463 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a8deadaf-704b-42f1-b955-aed9a444050e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:33.176115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8deadaf-704b-42f1-b955-aed9a444050e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:33.176741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8deadaf-704b-42f1-b955-aed9a444050e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:33.177677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8deadaf-704b-42f1-b955-aed9a444050e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:33.178102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8deadaf-704b-42f1-b955-aed9a444050e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:33.338224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a8deadaf-704b-42f1-b955-aed9a444050e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:33.346035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a8deadaf-704b-42f1-b955-aed9a444050e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.180767 Nov 08 17:41:33.346644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 303/577] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:33.775850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ae0b3908-40c3-4b8e-bf78-857cc3dda313 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:33.776447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ae0b3908-40c3-4b8e-bf78-857cc3dda313 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:33.783007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae0b3908-40c3-4b8e-bf78-857cc3dda313 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:33.783445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae0b3908-40c3-4b8e-bf78-857cc3dda313 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:33.784386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae0b3908-40c3-4b8e-bf78-857cc3dda313 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:33.784816 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae0b3908-40c3-4b8e-bf78-857cc3dda313 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:33.922710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ae0b3908-40c3-4b8e-bf78-857cc3dda313 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:33.938293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ae0b3908-40c3-4b8e-bf78-857cc3dda313 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1515 microversion: 2.1 time: 0.158659 Nov 08 17:41:33.938293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 275/578] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:33 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:34.025158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:34.025768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:34.032005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.032446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:34.033734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.034167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:34.140236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-3a22d53b-4c4c-4a0b-bf29-115b243d225d req-5f11b396-67a3-4d9a-b2e7-34873f7c55b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1b9538-1890-433c-9a61-e95fa423b0ed", "name": "network-vif-deleted", "tag": "d6088382-accd-47df-bbc8-f5b6496f749e"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:34.141890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:41:34.141890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:41:34.150733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-3a22d53b-4c4c-4a0b-bf29-115b243d225d req-5f11b396-67a3-4d9a-b2e7-34873f7c55b4 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.151294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-3a22d53b-4c4c-4a0b-bf29-115b243d225d req-5f11b396-67a3-4d9a-b2e7-34873f7c55b4 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:34.165369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-3a22d53b-4c4c-4a0b-bf29-115b243d225d req-5f11b396-67a3-4d9a-b2e7-34873f7c55b4 service nova] Creating event network-vif-deleted:d6088382-accd-47df-bbc8-f5b6496f749e for instance 2e1b9538-1890-433c-9a61-e95fa423b0ed on hv-cinder-81689 Nov 08 17:41:34.170527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-3a22d53b-4c4c-4a0b-bf29-115b243d225d req-5f11b396-67a3-4d9a-b2e7-34873f7c55b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035144 Nov 08 17:41:34.178539 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 276/579] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:41:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:41:34.180112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dfc6adcf-1b7f-449c-b6b5-281a3cf36141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:34.180941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dfc6adcf-1b7f-449c-b6b5-281a3cf36141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:34.187250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dfc6adcf-1b7f-449c-b6b5-281a3cf36141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.187822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dfc6adcf-1b7f-449c-b6b5-281a3cf36141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:34.188773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dfc6adcf-1b7f-449c-b6b5-281a3cf36141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.189778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dfc6adcf-1b7f-449c-b6b5-281a3cf36141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:34.190661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:34.199936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:34.201691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:34.203395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c6640341-c2c6-4c16-b387-cab66d95409e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1750 microversion: 2.20 time: 0.182270 Nov 08 17:41:34.205556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 304/580] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:34.346128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dfc6adcf-1b7f-449c-b6b5-281a3cf36141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:34.354939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dfc6adcf-1b7f-449c-b6b5-281a3cf36141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1319 microversion: 2.1 time: 0.178953 Nov 08 17:41:34.355815 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 277/581] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:34 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:34.363917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f28d1d52-c0f7-424f-a9f2-4445c277bf65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:34.364822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f28d1d52-c0f7-424f-a9f2-4445c277bf65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:34.371919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f28d1d52-c0f7-424f-a9f2-4445c277bf65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.372587 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f28d1d52-c0f7-424f-a9f2-4445c277bf65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:34.373637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f28d1d52-c0f7-424f-a9f2-4445c277bf65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.374333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f28d1d52-c0f7-424f-a9f2-4445c277bf65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:34.534159 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f28d1d52-c0f7-424f-a9f2-4445c277bf65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:34.547680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f28d1d52-c0f7-424f-a9f2-4445c277bf65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.188990 Nov 08 17:41:34.551030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 305/582] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:34.952795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:34.954055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:34.961437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.961878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:34.962741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:34.964765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.022361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:35.022361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.022361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lazy-loading 'fault' on Instance uuid 2e1b9538-1890-433c-9a61-e95fa423b0ed {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:41:35.074675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:35.083354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b1423156-ac6c-4994-bc01-d4ea9810f84a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 200 len: 1308 microversion: 2.1 time: 0.133973 Nov 08 17:41:35.084724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 278/583] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:34 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:35.165242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-9344826c-5491-4139-afce-8c1c9f9963e1 req-0e9ddde5-d013-4f59-8d6e-7a639f30967d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6c9295-0da3-43bd-b2fa-5709f1c39dbe", "name": "network-vif-plugged", "status": "completed", "tag": "a97c62f3-4ad6-47b6-ab5e-55e6bae21f78"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:35.167653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:41:35.167653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:41:35.175854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-9344826c-5491-4139-afce-8c1c9f9963e1 req-0e9ddde5-d013-4f59-8d6e-7a639f30967d service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:35.176289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-9344826c-5491-4139-afce-8c1c9f9963e1 req-0e9ddde5-d013-4f59-8d6e-7a639f30967d service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.187488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-9344826c-5491-4139-afce-8c1c9f9963e1 req-0e9ddde5-d013-4f59-8d6e-7a639f30967d service nova] Creating event network-vif-plugged:a97c62f3-4ad6-47b6-ab5e-55e6bae21f78 for instance 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe on hv-cinder-81689 Nov 08 17:41:35.192839 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-9344826c-5491-4139-afce-8c1c9f9963e1 req-0e9ddde5-d013-4f59-8d6e-7a639f30967d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Nov 08 17:41:35.193438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 306/584] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:41:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:41:35.226553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:35.227093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:35.233239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:35.233713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.238905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:35.238905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.374266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f0f97883-5eb3-4456-a85f-5577c56caf05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:35.374989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f0f97883-5eb3-4456-a85f-5577c56caf05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:35.384649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0f97883-5eb3-4456-a85f-5577c56caf05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:35.385383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0f97883-5eb3-4456-a85f-5577c56caf05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.386714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0f97883-5eb3-4456-a85f-5577c56caf05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:35.387456 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0f97883-5eb3-4456-a85f-5577c56caf05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.440175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:35.449094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:35.450618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:35.451776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-64bc394b-79a2-47e2-a5ca-bcd7d183aea1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.229483 Nov 08 17:41:35.452338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 279/585] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:35.567850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f0f97883-5eb3-4456-a85f-5577c56caf05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:35.571710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6c4e387e-578f-4a84-acf0-bb5cdc6a39bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:35.573925 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6c4e387e-578f-4a84-acf0-bb5cdc6a39bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:35.575578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f0f97883-5eb3-4456-a85f-5577c56caf05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1319 microversion: 2.1 time: 0.205357 Nov 08 17:41:35.580634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c4e387e-578f-4a84-acf0-bb5cdc6a39bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:35.581399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c4e387e-578f-4a84-acf0-bb5cdc6a39bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.582388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c4e387e-578f-4a84-acf0-bb5cdc6a39bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:35.583053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c4e387e-578f-4a84-acf0-bb5cdc6a39bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:35.585352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 307/586] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:35 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:35.722572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6c4e387e-578f-4a84-acf0-bb5cdc6a39bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:35.729723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6c4e387e-578f-4a84-acf0-bb5cdc6a39bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.168458 Nov 08 17:41:35.730352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 280/587] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:36.102228 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:36.102987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 2e1b9538-1890-433c-9a61-e95fa423b0ed] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:36.108732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:36.109179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:36.109938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:36.110370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:36.124541 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] HTTP exception thrown: Instance 2e1b9538-1890-433c-9a61-e95fa423b0ed could not be found. Nov 08 17:41:36.129245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Returning 404 to user: Instance 2e1b9538-1890-433c-9a61-e95fa423b0ed could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:41:36.129245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a6d87d98-b7ce-48a9-8841-8a0da4474f18 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed" status: 404 len: 111 microversion: 2.1 time: 0.027434 Nov 08 17:41:36.129245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 308/588] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:36 2021] GET /compute/v2.1/servers/2e1b9538-1890-433c-9a61-e95fa423b0ed => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:41:36.512926 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:36.513527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:36.519788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:36.520229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:36.520995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:36.521426 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:36.596212 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-572d7eab-0aa4-431e-ae3a-8b8f00fb1889 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:36.596822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-572d7eab-0aa4-431e-ae3a-8b8f00fb1889 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:36.603887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572d7eab-0aa4-431e-ae3a-8b8f00fb1889 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:36.604440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572d7eab-0aa4-431e-ae3a-8b8f00fb1889 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:36.605562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572d7eab-0aa4-431e-ae3a-8b8f00fb1889 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:36.606060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572d7eab-0aa4-431e-ae3a-8b8f00fb1889 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:36.683618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:36.691918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:36.693377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:36.694533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f2b3fca5-4611-45c1-ba0d-aa70c194b355 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.185308 Nov 08 17:41:36.695090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 281/589] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:36.746600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-361c4f3c-af79-4cfd-8c20-798efbd99382 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:36.747249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-361c4f3c-af79-4cfd-8c20-798efbd99382 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:36.752953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-361c4f3c-af79-4cfd-8c20-798efbd99382 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:36.753392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-361c4f3c-af79-4cfd-8c20-798efbd99382 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:36.754158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-361c4f3c-af79-4cfd-8c20-798efbd99382 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:36.754611 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-361c4f3c-af79-4cfd-8c20-798efbd99382 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:36.755569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-572d7eab-0aa4-431e-ae3a-8b8f00fb1889 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:36.763467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-572d7eab-0aa4-431e-ae3a-8b8f00fb1889 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1319 microversion: 2.1 time: 0.171318 Nov 08 17:41:36.772399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 309/590] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:36 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:36.913789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-361c4f3c-af79-4cfd-8c20-798efbd99382 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:36.921266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-361c4f3c-af79-4cfd-8c20-798efbd99382 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.178245 Nov 08 17:41:36.921852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 282/591] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:37.461094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0cd029c0-6bfd-4cec-be13-464cda0bef87 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:37.461825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0cd029c0-6bfd-4cec-be13-464cda0bef87 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:37.468034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0cd029c0-6bfd-4cec-be13-464cda0bef87 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:37.468476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0cd029c0-6bfd-4cec-be13-464cda0bef87 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:37.469249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0cd029c0-6bfd-4cec-be13-464cda0bef87 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:37.469740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0cd029c0-6bfd-4cec-be13-464cda0bef87 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:37.495642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0cd029c0-6bfd-4cec-be13-464cda0bef87 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:41:37.713782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:37.714627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:37.721399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:37.721904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:37.722737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:37.723167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:37.859952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:37.869265 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:37.870801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:37.871974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-272fb165-98a7-43b4-8598-b53d36341d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.162769 Nov 08 17:41:37.872503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 283/592] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:37.888152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cea31df7-106d-43a0-ab14-305ac12e0470 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:37.888754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cea31df7-106d-43a0-ab14-305ac12e0470 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:37.897390 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cea31df7-106d-43a0-ab14-305ac12e0470 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:37.897964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cea31df7-106d-43a0-ab14-305ac12e0470 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:37.899078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cea31df7-106d-43a0-ab14-305ac12e0470 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:37.899607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cea31df7-106d-43a0-ab14-305ac12e0470 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:37.973006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0cd029c0-6bfd-4cec-be13-464cda0bef87 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 204 len: 0 microversion: 2.1 time: 0.516728 Nov 08 17:41:37.973839 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 310/593] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:41:37 2021] DELETE /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 08 17:41:37.979900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5fb97729-edb6-41d6-a978-4290821f2f3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:37.980580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5fb97729-edb6-41d6-a978-4290821f2f3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:37.987341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fb97729-edb6-41d6-a978-4290821f2f3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:37.987796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fb97729-edb6-41d6-a978-4290821f2f3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:37.988610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fb97729-edb6-41d6-a978-4290821f2f3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:37.989036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fb97729-edb6-41d6-a978-4290821f2f3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:38.086966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cea31df7-106d-43a0-ab14-305ac12e0470 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:38.096335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cea31df7-106d-43a0-ab14-305ac12e0470 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1508 microversion: 2.1 time: 0.221816 Nov 08 17:41:38.096932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 284/594] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:37 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:38.108335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d64141b2-5a41-49f6-a437-0d84779c864e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:38.108335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d64141b2-5a41-49f6-a437-0d84779c864e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:38.108540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d64141b2-5a41-49f6-a437-0d84779c864e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:38.108846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d64141b2-5a41-49f6-a437-0d84779c864e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:38.109836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d64141b2-5a41-49f6-a437-0d84779c864e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:38.110086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d64141b2-5a41-49f6-a437-0d84779c864e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:38.223519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5fb97729-edb6-41d6-a978-4290821f2f3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:38.236969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5fb97729-edb6-41d6-a978-4290821f2f3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.259562 Nov 08 17:41:38.239720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 311/595] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:38.291757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d64141b2-5a41-49f6-a437-0d84779c864e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:38.299977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d64141b2-5a41-49f6-a437-0d84779c864e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.201734 Nov 08 17:41:38.300773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 285/596] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:38 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:38.890776 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:38.891635 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:38.904403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:38.905059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:38.905990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:38.906301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:39.062827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:39.071760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:39.073260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:39.074408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-97d1c155-85a1-44d3-9d34-3053a9eeffbb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.187797 Nov 08 17:41:39.079513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 312/597] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:39.261699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-def096c0-2c4c-492d-a84c-8276a75e40b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:39.262944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-def096c0-2c4c-492d-a84c-8276a75e40b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:39.269383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-def096c0-2c4c-492d-a84c-8276a75e40b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:39.269830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-def096c0-2c4c-492d-a84c-8276a75e40b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:39.270631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-def096c0-2c4c-492d-a84c-8276a75e40b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:39.271089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-def096c0-2c4c-492d-a84c-8276a75e40b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:39.317845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-87e4ec7d-0ae7-4f83-ad80-3d59dbd30c1d tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:39.318831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-87e4ec7d-0ae7-4f83-ad80-3d59dbd30c1d tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:39.327224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-87e4ec7d-0ae7-4f83-ad80-3d59dbd30c1d tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:39.328720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-87e4ec7d-0ae7-4f83-ad80-3d59dbd30c1d tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:39.329871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-87e4ec7d-0ae7-4f83-ad80-3d59dbd30c1d tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:39.331832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-87e4ec7d-0ae7-4f83-ad80-3d59dbd30c1d tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:39.449452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-def096c0-2c4c-492d-a84c-8276a75e40b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:39.458071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-def096c0-2c4c-492d-a84c-8276a75e40b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.205464 Nov 08 17:41:39.460239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 286/598] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:39.552715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-87e4ec7d-0ae7-4f83-ad80-3d59dbd30c1d tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:39.559341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-87e4ec7d-0ae7-4f83-ad80-3d59dbd30c1d tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.245268 Nov 08 17:41:39.560538 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 313/599] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:39 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:40.093985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:40.094750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:40.101007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:40.101457 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:40.102243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:40.102703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:40.260078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:40.287726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:40.289975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:40.291568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-48a359f0-247f-4a35-9498-21914341a995 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.201292 Nov 08 17:41:40.311237 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 287/600] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:40.476666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bfd2ba54-85dc-497b-9457-5bdbace46c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:40.478080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bfd2ba54-85dc-497b-9457-5bdbace46c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:40.485008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfd2ba54-85dc-497b-9457-5bdbace46c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:40.485825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfd2ba54-85dc-497b-9457-5bdbace46c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:40.486964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfd2ba54-85dc-497b-9457-5bdbace46c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:40.487415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfd2ba54-85dc-497b-9457-5bdbace46c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:40.577140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d567eef0-ed23-4cb2-a4a6-a65d7a3104ab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:40.577792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d567eef0-ed23-4cb2-a4a6-a65d7a3104ab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:40.586264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d567eef0-ed23-4cb2-a4a6-a65d7a3104ab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:40.586731 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d567eef0-ed23-4cb2-a4a6-a65d7a3104ab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:40.587547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d567eef0-ed23-4cb2-a4a6-a65d7a3104ab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:40.588714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d567eef0-ed23-4cb2-a4a6-a65d7a3104ab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:40.666754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bfd2ba54-85dc-497b-9457-5bdbace46c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:40.676221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bfd2ba54-85dc-497b-9457-5bdbace46c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.203109 Nov 08 17:41:40.676780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 314/601] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:40.774865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d567eef0-ed23-4cb2-a4a6-a65d7a3104ab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:40.787122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d567eef0-ed23-4cb2-a4a6-a65d7a3104ab tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.214045 Nov 08 17:41:40.787820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 288/602] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:40 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:41.312575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:41.313253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:41.326091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:41.326558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:41.327544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:41.328135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:41.539925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:41.539925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:41.540690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:41.540690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3deb6254-c550-4628-af7a-088763da52ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.212769 Nov 08 17:41:41.540690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 315/603] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:41.693411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-775e9527-07c8-478c-8ee9-c9c8cb57e131 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:41.694073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-775e9527-07c8-478c-8ee9-c9c8cb57e131 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:41.700396 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-775e9527-07c8-478c-8ee9-c9c8cb57e131 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:41.700832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-775e9527-07c8-478c-8ee9-c9c8cb57e131 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:41.701607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-775e9527-07c8-478c-8ee9-c9c8cb57e131 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:41.702046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-775e9527-07c8-478c-8ee9-c9c8cb57e131 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:41.805407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-79264711-eba7-44a6-a86b-f6748cc559d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:41.806375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-79264711-eba7-44a6-a86b-f6748cc559d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:41.816943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79264711-eba7-44a6-a86b-f6748cc559d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:41.824691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79264711-eba7-44a6-a86b-f6748cc559d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:41.826507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79264711-eba7-44a6-a86b-f6748cc559d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:41.827311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79264711-eba7-44a6-a86b-f6748cc559d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:41.853876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-775e9527-07c8-478c-8ee9-c9c8cb57e131 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:41.862786 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-775e9527-07c8-478c-8ee9-c9c8cb57e131 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.172962 Nov 08 17:41:41.863800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 289/604] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:41.997583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-79264711-eba7-44a6-a86b-f6748cc559d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:42.006223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-79264711-eba7-44a6-a86b-f6748cc559d2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.205034 Nov 08 17:41:42.007137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 316/605] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:41 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:42.559416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:42.560374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:42.573670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:42.575047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:42.576123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:42.576632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:42.770727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:42.778968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:42.780681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:42.781895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3a4462f2-3433-44c5-aff5-d4efb2983d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.226759 Nov 08 17:41:42.782641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 290/606] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:42.880722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-49be968b-1c74-4b7d-a745-3c9e186795b1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:42.886248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-49be968b-1c74-4b7d-a745-3c9e186795b1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:42.887580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-49be968b-1c74-4b7d-a745-3c9e186795b1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:42.888028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-49be968b-1c74-4b7d-a745-3c9e186795b1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:42.888798 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-49be968b-1c74-4b7d-a745-3c9e186795b1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:42.889226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-49be968b-1c74-4b7d-a745-3c9e186795b1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:43.029545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c53eca86-060f-4694-be37-82525a9bfd0a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:43.029545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c53eca86-060f-4694-be37-82525a9bfd0a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:43.031929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c53eca86-060f-4694-be37-82525a9bfd0a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:43.032441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c53eca86-060f-4694-be37-82525a9bfd0a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:43.034067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c53eca86-060f-4694-be37-82525a9bfd0a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:43.035955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c53eca86-060f-4694-be37-82525a9bfd0a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:43.145647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-49be968b-1c74-4b7d-a745-3c9e186795b1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:43.154183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-49be968b-1c74-4b7d-a745-3c9e186795b1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.277148 Nov 08 17:41:43.155063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 317/607] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:43.306153 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c53eca86-060f-4694-be37-82525a9bfd0a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:43.313758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c53eca86-060f-4694-be37-82525a9bfd0a tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.292360 Nov 08 17:41:43.315225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 291/608] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:43 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:43.803772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:43.805439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:43.813722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:43.815858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:43.817398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:43.818067 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:43.997165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:44.006745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:44.008265 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:44.009436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9f5b5395-ef63-4a8c-8c6a-275ad2f4e61d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.211780 Nov 08 17:41:44.010268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 318/609] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:44.177839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e1046072-656c-44c2-bb8b-fb8fe5ce17e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:44.177839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e1046072-656c-44c2-bb8b-fb8fe5ce17e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:44.184202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1046072-656c-44c2-bb8b-fb8fe5ce17e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:44.186252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1046072-656c-44c2-bb8b-fb8fe5ce17e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:44.186252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1046072-656c-44c2-bb8b-fb8fe5ce17e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:44.186519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1046072-656c-44c2-bb8b-fb8fe5ce17e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:44.332543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3b2e69b1-32d5-4e42-97c1-86375023c163 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:44.333614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3b2e69b1-32d5-4e42-97c1-86375023c163 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:44.342838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b1-32d5-4e42-97c1-86375023c163 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:44.343467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b1-32d5-4e42-97c1-86375023c163 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:44.344524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b1-32d5-4e42-97c1-86375023c163 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:44.345057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3b2e69b1-32d5-4e42-97c1-86375023c163 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:44.649509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e1046072-656c-44c2-bb8b-fb8fe5ce17e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:44.649509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e1046072-656c-44c2-bb8b-fb8fe5ce17e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.379750 Nov 08 17:41:44.649509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 292/610] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:44.649804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3b2e69b1-32d5-4e42-97c1-86375023c163 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:44.649804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3b2e69b1-32d5-4e42-97c1-86375023c163 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.281180 Nov 08 17:41:44.649804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 319/611] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:44 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:45.028534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:45.033435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:45.036614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:45.037068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:45.037866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:45.038294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:45.485540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:45.508938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:45.510695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:45.526511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7b028e89-2472-4b05-a68e-bb7180a591a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.500382 Nov 08 17:41:45.527487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 293/612] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:45.565347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ec8ad0d3-5dce-4011-9ed3-4e57f4051095 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:45.566200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ec8ad0d3-5dce-4011-9ed3-4e57f4051095 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:45.572651 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ec8ad0d3-5dce-4011-9ed3-4e57f4051095 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:45.573096 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ec8ad0d3-5dce-4011-9ed3-4e57f4051095 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:45.573875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ec8ad0d3-5dce-4011-9ed3-4e57f4051095 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:45.574318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ec8ad0d3-5dce-4011-9ed3-4e57f4051095 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:45.626521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-51bb228f-584f-4046-807c-5a6fe97765dc tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:45.627886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-51bb228f-584f-4046-807c-5a6fe97765dc tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:45.636290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51bb228f-584f-4046-807c-5a6fe97765dc tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:45.637464 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51bb228f-584f-4046-807c-5a6fe97765dc tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:45.638479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51bb228f-584f-4046-807c-5a6fe97765dc tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:45.638936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51bb228f-584f-4046-807c-5a6fe97765dc tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:45.892072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ec8ad0d3-5dce-4011-9ed3-4e57f4051095 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:45.899459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ec8ad0d3-5dce-4011-9ed3-4e57f4051095 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.338219 Nov 08 17:41:45.900049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 320/613] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:45.923750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-51bb228f-584f-4046-807c-5a6fe97765dc tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:45.949607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-51bb228f-584f-4046-807c-5a6fe97765dc tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.326660 Nov 08 17:41:45.961850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 294/614] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:45 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:46.545932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:46.547175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:46.556645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:46.557332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:46.558351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:46.559455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:46.855810 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:46.866760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:46.868270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:46.869463 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-962fa2ac-aa06-4e79-813e-fbe266f20358 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.327730 Nov 08 17:41:46.870033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 321/615] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:46.919352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e22eb6c9-0d8c-4399-bc16-c9a5d786c272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:46.921868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e22eb6c9-0d8c-4399-bc16-c9a5d786c272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:46.933096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e22eb6c9-0d8c-4399-bc16-c9a5d786c272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:46.935275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e22eb6c9-0d8c-4399-bc16-c9a5d786c272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:46.938660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e22eb6c9-0d8c-4399-bc16-c9a5d786c272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:46.938660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e22eb6c9-0d8c-4399-bc16-c9a5d786c272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:46.973385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a5b5e9aa-a4a7-4352-944f-50640f275300 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:46.974007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a5b5e9aa-a4a7-4352-944f-50640f275300 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:46.984484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a5b5e9aa-a4a7-4352-944f-50640f275300 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:46.984939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a5b5e9aa-a4a7-4352-944f-50640f275300 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:46.985855 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a5b5e9aa-a4a7-4352-944f-50640f275300 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:46.986346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a5b5e9aa-a4a7-4352-944f-50640f275300 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:47.357560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e22eb6c9-0d8c-4399-bc16-c9a5d786c272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:47.357560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e22eb6c9-0d8c-4399-bc16-c9a5d786c272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.393736 Nov 08 17:41:47.357560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 295/616] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:47.358008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a5b5e9aa-a4a7-4352-944f-50640f275300 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:47.358008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a5b5e9aa-a4a7-4352-944f-50640f275300 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.358392 Nov 08 17:41:47.358008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 322/617] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:46 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:47.893821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:47.896409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:47.907309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:47.907309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:47.907309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:47.907309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:48.198428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:48.209955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:48.211831 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:48.213235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-294d97f9-ec6a-47f3-aba5-7de8ad3b456e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.325306 Nov 08 17:41:48.213784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 296/618] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:48.324815 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-09e827bd-dd95-4f29-9d27-81b08fd598f4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:48.325442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-09e827bd-dd95-4f29-9d27-81b08fd598f4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:48.337956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09e827bd-dd95-4f29-9d27-81b08fd598f4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:48.338921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09e827bd-dd95-4f29-9d27-81b08fd598f4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:48.340130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09e827bd-dd95-4f29-9d27-81b08fd598f4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:48.340795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09e827bd-dd95-4f29-9d27-81b08fd598f4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:48.342853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-548a6478-a6ad-4ea5-b3dd-45bbddc710a4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:48.344044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-548a6478-a6ad-4ea5-b3dd-45bbddc710a4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:48.359423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-548a6478-a6ad-4ea5-b3dd-45bbddc710a4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:48.370310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-548a6478-a6ad-4ea5-b3dd-45bbddc710a4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:48.370310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-548a6478-a6ad-4ea5-b3dd-45bbddc710a4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:48.370310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-548a6478-a6ad-4ea5-b3dd-45bbddc710a4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:48.930793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-548a6478-a6ad-4ea5-b3dd-45bbddc710a4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:48.940986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-09e827bd-dd95-4f29-9d27-81b08fd598f4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:48.942374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-548a6478-a6ad-4ea5-b3dd-45bbddc710a4 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.602821 Nov 08 17:41:48.954258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 297/619] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:48 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:48.958826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-09e827bd-dd95-4f29-9d27-81b08fd598f4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.637614 Nov 08 17:41:48.970085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 323/620] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:49.231895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:49.232541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:49.239109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:49.239811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:49.240746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:49.241179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:49.484640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:49.495331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:49.497084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:49.498432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-de04aa5e-9e8f-4606-af5f-5d69ca05852f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.270289 Nov 08 17:41:49.499012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 298/621] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:49.962181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a8ef51b2-68e0-47e3-960a-99932747897f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:49.963092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a8ef51b2-68e0-47e3-960a-99932747897f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:49.977903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8ef51b2-68e0-47e3-960a-99932747897f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:49.993158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8ef51b2-68e0-47e3-960a-99932747897f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:49.993256 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-74889558-da7d-416e-a85a-9da60368bd9f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:49.993345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8ef51b2-68e0-47e3-960a-99932747897f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:49.994068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-74889558-da7d-416e-a85a-9da60368bd9f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:49.994165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8ef51b2-68e0-47e3-960a-99932747897f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:50.012369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-74889558-da7d-416e-a85a-9da60368bd9f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:50.017104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-74889558-da7d-416e-a85a-9da60368bd9f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:50.018701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-74889558-da7d-416e-a85a-9da60368bd9f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:50.019245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-74889558-da7d-416e-a85a-9da60368bd9f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:50.285244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a8ef51b2-68e0-47e3-960a-99932747897f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:50.291568 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a8ef51b2-68e0-47e3-960a-99932747897f tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.334393 Nov 08 17:41:50.299208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 324/622] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:49 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:50.338165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-74889558-da7d-416e-a85a-9da60368bd9f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:50.348528 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-74889558-da7d-416e-a85a-9da60368bd9f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.371444 Nov 08 17:41:50.349574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 299/623] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:50.517723 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:50.520758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:50.530896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:50.531634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:50.534636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:50.535423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:50.783692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:50.796236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:50.798150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:50.800401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-46148a4a-8f68-4a7d-b02c-6f960e4d52e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.286724 Nov 08 17:41:50.808570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 325/624] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:51.313071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0fbbd024-5988-45df-bb8a-027da8eeec24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:51.315126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0fbbd024-5988-45df-bb8a-027da8eeec24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:51.323088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0fbbd024-5988-45df-bb8a-027da8eeec24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:51.325205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0fbbd024-5988-45df-bb8a-027da8eeec24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:51.326055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0fbbd024-5988-45df-bb8a-027da8eeec24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:51.326821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0fbbd024-5988-45df-bb8a-027da8eeec24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:51.364925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b327310e-9ea8-4250-8941-9654d965a492 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:51.365535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b327310e-9ea8-4250-8941-9654d965a492 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:51.381445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b327310e-9ea8-4250-8941-9654d965a492 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:51.382363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b327310e-9ea8-4250-8941-9654d965a492 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:51.384148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b327310e-9ea8-4250-8941-9654d965a492 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:51.385040 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b327310e-9ea8-4250-8941-9654d965a492 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:51.525832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0fbbd024-5988-45df-bb8a-027da8eeec24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:51.533953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0fbbd024-5988-45df-bb8a-027da8eeec24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.226883 Nov 08 17:41:51.551264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 300/625] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:51 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:51.608671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b327310e-9ea8-4250-8941-9654d965a492 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:51.617461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b327310e-9ea8-4250-8941-9654d965a492 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.256155 Nov 08 17:41:51.628164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 326/626] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:51.823052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:51.823649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:51.831413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:51.831866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:51.832677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:51.833312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:52.049587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:52.058059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:52.059488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:52.060862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a7408bb3-b95e-449c-88f9-33f24bcdcdb1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.241716 Nov 08 17:41:52.061411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 301/627] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:52.551168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-74d34d68-ae8e-4e61-a229-acfe028441d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:52.552396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-74d34d68-ae8e-4e61-a229-acfe028441d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:52.559804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74d34d68-ae8e-4e61-a229-acfe028441d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:52.560465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74d34d68-ae8e-4e61-a229-acfe028441d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:52.561412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74d34d68-ae8e-4e61-a229-acfe028441d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:52.561999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74d34d68-ae8e-4e61-a229-acfe028441d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:52.635801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-332eb58b-34e5-4aba-b749-aec39df3fbf9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:52.637527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-332eb58b-34e5-4aba-b749-aec39df3fbf9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:52.646717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-332eb58b-34e5-4aba-b749-aec39df3fbf9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:52.647442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-332eb58b-34e5-4aba-b749-aec39df3fbf9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:52.649573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-332eb58b-34e5-4aba-b749-aec39df3fbf9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:52.650022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-332eb58b-34e5-4aba-b749-aec39df3fbf9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:52.850055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-74d34d68-ae8e-4e61-a229-acfe028441d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:52.865647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-74d34d68-ae8e-4e61-a229-acfe028441d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.310637 Nov 08 17:41:52.867090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 327/628] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:52 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:52.913665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-332eb58b-34e5-4aba-b749-aec39df3fbf9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:52.922484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-332eb58b-34e5-4aba-b749-aec39df3fbf9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.291099 Nov 08 17:41:52.933529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 302/629] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:53.080959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:53.081660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:53.087582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:53.088291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:53.089214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:53.089685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:53.268375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:53.282788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:53.285993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:53.287396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-113380a4-cafd-467f-aee0-9824dbbea9e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.211408 Nov 08 17:41:53.288356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 328/630] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:53.885444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-78c42fcf-1d4f-48c2-8163-835b474d27d0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:53.885444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-78c42fcf-1d4f-48c2-8163-835b474d27d0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:53.896985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78c42fcf-1d4f-48c2-8163-835b474d27d0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:53.899060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78c42fcf-1d4f-48c2-8163-835b474d27d0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:53.900271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78c42fcf-1d4f-48c2-8163-835b474d27d0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:53.900996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78c42fcf-1d4f-48c2-8163-835b474d27d0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:53.942180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f362f8eb-6456-4edf-ae25-79b299f48369 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:53.943597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f362f8eb-6456-4edf-ae25-79b299f48369 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:53.960009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f362f8eb-6456-4edf-ae25-79b299f48369 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:53.963673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f362f8eb-6456-4edf-ae25-79b299f48369 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:53.963673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f362f8eb-6456-4edf-ae25-79b299f48369 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:53.963673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f362f8eb-6456-4edf-ae25-79b299f48369 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:54.374479 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f362f8eb-6456-4edf-ae25-79b299f48369 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:54.380660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-78c42fcf-1d4f-48c2-8163-835b474d27d0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:54.392968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-78c42fcf-1d4f-48c2-8163-835b474d27d0 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1514 microversion: 2.1 time: 0.513987 Nov 08 17:41:54.400227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f362f8eb-6456-4edf-ae25-79b299f48369 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1523 microversion: 2.1 time: 0.461777 Nov 08 17:41:54.406936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 329/631] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1523 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:54.409999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 303/632] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:53 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1514 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:54.435728 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:54.436526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:54.451156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:54.451599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:54.452387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:54.452819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:54.489366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-e34406c4-a8d4-415b-ab73-ed12b0bfc49c req-93f0a190-e900-4c81-9b14-992ea5a88d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4f5525-8b55-43ab-a990-9d151f90f74a", "name": "network-vif-deleted", "tag": "be2a67f9-fef7-4f3a-849f-362d77b76ae3"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:54.491906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:41:54.491906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:41:54.514184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-e34406c4-a8d4-415b-ab73-ed12b0bfc49c req-93f0a190-e900-4c81-9b14-992ea5a88d37 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:54.516223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-e34406c4-a8d4-415b-ab73-ed12b0bfc49c req-93f0a190-e900-4c81-9b14-992ea5a88d37 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:54.547446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-e34406c4-a8d4-415b-ab73-ed12b0bfc49c req-93f0a190-e900-4c81-9b14-992ea5a88d37 service nova] Creating event network-vif-deleted:be2a67f9-fef7-4f3a-849f-362d77b76ae3 for instance 5f4f5525-8b55-43ab-a990-9d151f90f74a on hv-cinder-81689 Nov 08 17:41:54.567335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-e34406c4-a8d4-415b-ab73-ed12b0bfc49c req-93f0a190-e900-4c81-9b14-992ea5a88d37 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082397 Nov 08 17:41:54.570291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 304/633] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:41:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:41:54.834332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:54.844918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:54.852263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:54.853705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-397fa4dd-843b-4eb0-8258-9a243a6e651f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.442025 Nov 08 17:41:54.867404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 330/634] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:55.429388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-03f9c3d1-31e1-4dcc-9e3c-9be85ea2f039 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:55.430240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-03f9c3d1-31e1-4dcc-9e3c-9be85ea2f039 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:55.436963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03f9c3d1-31e1-4dcc-9e3c-9be85ea2f039 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.437521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03f9c3d1-31e1-4dcc-9e3c-9be85ea2f039 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.438369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03f9c3d1-31e1-4dcc-9e3c-9be85ea2f039 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.438910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03f9c3d1-31e1-4dcc-9e3c-9be85ea2f039 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.442121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:55.442774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:55.451812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.452255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.453590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.454034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.495370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.496061 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.496518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lazy-loading 'fault' on Instance uuid 5f4f5525-8b55-43ab-a990-9d151f90f74a {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:41:55.551020 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:55.578941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-60a28883-9bb5-4892-b42d-f3d24bc379ee tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 200 len: 1307 microversion: 2.1 time: 0.143720 Nov 08 17:41:55.580132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 331/635] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:55 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:55.643301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-03f9c3d1-31e1-4dcc-9e3c-9be85ea2f039 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:55.656469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-03f9c3d1-31e1-4dcc-9e3c-9be85ea2f039 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1503 microversion: 2.1 time: 0.231074 Nov 08 17:41:55.657318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 305/636] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:55.680668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34e8ea5f-6ef4-4eaf-ad3c-be1a991f841e"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:55.681789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:55.703140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.703670 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.704714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.705428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.732205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] HTTP exception thrown: Cannot 'attach_volume' instance 76806517-5f8b-4d47-89f6-66e876baa194 while it is in vm_state rescued Nov 08 17:41:55.733052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Returning 409 to user: Cannot 'attach_volume' instance 76806517-5f8b-4d47-89f6-66e876baa194 while it is in vm_state rescued {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:41:55.734102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5c672924-26df-48a0-a103-828f6f3a85bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057496 Nov 08 17:41:55.738495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 332/637] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:41:55 2021] POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 08 17:41:55.744702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-320f40a5-c967-4d96-93b7-9019edd35b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:55.745239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-320f40a5-c967-4d96-93b7-9019edd35b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:55.752307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-320f40a5-c967-4d96-93b7-9019edd35b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.760002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-320f40a5-c967-4d96-93b7-9019edd35b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.760002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-320f40a5-c967-4d96-93b7-9019edd35b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.760002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-320f40a5-c967-4d96-93b7-9019edd35b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.872768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:55.873372 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:55.879879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.880325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.881111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:55.881546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:55.983517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-320f40a5-c967-4d96-93b7-9019edd35b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action" status: 202 len: 0 microversion: 2.1 time: 0.243437 Nov 08 17:41:55.987465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 306/638] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:41:55 2021] POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:41:55.997904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d968ea12-be10-4c62-bbde-5c12a9c394fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:56.000536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d968ea12-be10-4c62-bbde-5c12a9c394fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:56.016741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d968ea12-be10-4c62-bbde-5c12a9c394fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:56.017286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d968ea12-be10-4c62-bbde-5c12a9c394fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:56.018228 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d968ea12-be10-4c62-bbde-5c12a9c394fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:56.021783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d968ea12-be10-4c62-bbde-5c12a9c394fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:56.067519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:56.083402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:56.089556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:56.090897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-73ee78b0-fbd8-4342-b720-811dd71021c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.222155 Nov 08 17:41:56.103432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 333/639] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:56.436841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d968ea12-be10-4c62-bbde-5c12a9c394fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:56.445389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d968ea12-be10-4c62-bbde-5c12a9c394fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1511 microversion: 2.1 time: 0.453919 Nov 08 17:41:56.449701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 307/640] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:41:56.603992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:56.605207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 5f4f5525-8b55-43ab-a990-9d151f90f74a] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:56.614239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:56.614967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:56.616640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:56.617628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:56.634949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] HTTP exception thrown: Instance 5f4f5525-8b55-43ab-a990-9d151f90f74a could not be found. Nov 08 17:41:56.635808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Returning 404 to user: Instance 5f4f5525-8b55-43ab-a990-9d151f90f74a could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:41:56.636917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-697fd7b5-2670-4297-8057-991fdc6997d1 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a" status: 404 len: 111 microversion: 2.1 time: 0.043894 Nov 08 17:41:56.638345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 334/641] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:56 2021] GET /compute/v2.1/servers/5f4f5525-8b55-43ab-a990-9d151f90f74a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:41:56.646020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c28807bb-2b97-42e8-a552-49e8cabbd632 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:56.647060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c28807bb-2b97-42e8-a552-49e8cabbd632 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:56.660650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c28807bb-2b97-42e8-a552-49e8cabbd632 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:56.661573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c28807bb-2b97-42e8-a552-49e8cabbd632 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:56.665154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c28807bb-2b97-42e8-a552-49e8cabbd632 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:56.666655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c28807bb-2b97-42e8-a552-49e8cabbd632 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:56.728931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c28807bb-2b97-42e8-a552-49e8cabbd632 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Going to try to terminate instance {{(pid=127763) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:41:57.111556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:57.112164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:57.129780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:57.130285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:57.131163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:57.133151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:57.154177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c28807bb-2b97-42e8-a552-49e8cabbd632 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 204 len: 0 microversion: 2.1 time: 0.511331 Nov 08 17:41:57.158500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 308/642] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:41:56 2021] DELETE /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:41:57.165127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d5f5fc66-a5be-4e29-8fd7-c90ec727f7e6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:57.165127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d5f5fc66-a5be-4e29-8fd7-c90ec727f7e6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:57.176471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d5f5fc66-a5be-4e29-8fd7-c90ec727f7e6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:57.177564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d5f5fc66-a5be-4e29-8fd7-c90ec727f7e6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:57.181781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d5f5fc66-a5be-4e29-8fd7-c90ec727f7e6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:57.183258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d5f5fc66-a5be-4e29-8fd7-c90ec727f7e6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:57.375461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:57.385551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:57.387008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:57.390824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7cfed36a-35f0-4dcf-b90c-3fa5d5e455d4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.282065 Nov 08 17:41:57.390824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 335/643] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:41:57.414960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d5f5fc66-a5be-4e29-8fd7-c90ec727f7e6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:57.426991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d5f5fc66-a5be-4e29-8fd7-c90ec727f7e6 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1513 microversion: 2.1 time: 0.265587 Nov 08 17:41:57.436343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 309/644] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:57 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:57.462683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1938540a-29a4-495b-870b-d6cecbc270ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:57.463695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1938540a-29a4-495b-870b-d6cecbc270ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:57.470406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1938540a-29a4-495b-870b-d6cecbc270ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:57.471273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1938540a-29a4-495b-870b-d6cecbc270ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:57.472227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1938540a-29a4-495b-870b-d6cecbc270ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:57.472998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1938540a-29a4-495b-870b-d6cecbc270ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:57.632062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1938540a-29a4-495b-870b-d6cecbc270ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:57.645620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1938540a-29a4-495b-870b-d6cecbc270ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1511 microversion: 2.1 time: 0.186508 Nov 08 17:41:57.650041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 336/645] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:58.365244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f044aff5-57b7-4ad2-836b-deefa93d7b0f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02294efe-ef2e-4847-aa14-107ac0db8bd3", "device": "/dev/sdb"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:58.367510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f044aff5-57b7-4ad2-836b-deefa93d7b0f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:58.375187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f044aff5-57b7-4ad2-836b-deefa93d7b0f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:58.375872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f044aff5-57b7-4ad2-836b-deefa93d7b0f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:58.376929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f044aff5-57b7-4ad2-836b-deefa93d7b0f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:58.377571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f044aff5-57b7-4ad2-836b-deefa93d7b0f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:58.407175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:58.418737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:58.429404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:58.429856 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:58.430689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:58.431122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:58.618230 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:58.629015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:58.630740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:58.632341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4138a568-c82d-4e2a-a353-2e2127bf95d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.228852 Nov 08 17:41:58.635047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 337/646] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:41:58.639632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-62654934-248c-4b27-8a11-4996d3df6473 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:58.640327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-62654934-248c-4b27-8a11-4996d3df6473 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:58.648227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62654934-248c-4b27-8a11-4996d3df6473 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:58.648680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62654934-248c-4b27-8a11-4996d3df6473 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:58.653586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62654934-248c-4b27-8a11-4996d3df6473 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:58.653586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62654934-248c-4b27-8a11-4996d3df6473 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:58.808782 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-62654934-248c-4b27-8a11-4996d3df6473 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:58.815145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-62654934-248c-4b27-8a11-4996d3df6473 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1513 microversion: 2.1 time: 0.178992 Nov 08 17:41:58.816053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 338/647] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:58 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:58.998572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9fa415dc-8130-4607-80d5-ad799dee3337 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] Action: 'create', calling method: .version_select at 0x7f06ec519ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-550971990"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:41:59.016448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-9fa415dc-8130-4607-80d5-ad799dee3337 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] Getting quotas for project 73b0bab426434f0d9854b7cabc176390. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:41:59.018519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-9fa415dc-8130-4607-80d5-ad799dee3337 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] Getting quotas for user 77642cbabeff424ba9fe2bbcf68530e7 and project 73b0bab426434f0d9854b7cabc176390. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:41:59.030544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9fa415dc-8130-4607-80d5-ad799dee3337 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] [83a2ba09-7aa0-4dcd-99a8-67aaaadf900f] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 08 17:41:59.230158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f044aff5-57b7-4ad2-836b-deefa93d7b0f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "POST /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868452 Nov 08 17:41:59.230895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 310/648] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:41:58 2021] POST /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:41:59.248536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2ebf7842-c8c3-4a19-91e4-9ae53fc7b6e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:59.248536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2ebf7842-c8c3-4a19-91e4-9ae53fc7b6e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:59.256397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ebf7842-c8c3-4a19-91e4-9ae53fc7b6e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:59.257452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ebf7842-c8c3-4a19-91e4-9ae53fc7b6e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:59.258666 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ebf7842-c8c3-4a19-91e4-9ae53fc7b6e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:59.259107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ebf7842-c8c3-4a19-91e4-9ae53fc7b6e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:59.502044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2ebf7842-c8c3-4a19-91e4-9ae53fc7b6e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:41:59.512005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2ebf7842-c8c3-4a19-91e4-9ae53fc7b6e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1511 microversion: 2.1 time: 0.272123 Nov 08 17:41:59.512592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 311/649] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:41:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:41:59.518758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ed8d9837-61ad-46e5-b9cb-31b5900fcd2d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:59.522119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ed8d9837-61ad-46e5-b9cb-31b5900fcd2d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:59.529684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed8d9837-61ad-46e5-b9cb-31b5900fcd2d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:59.530170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed8d9837-61ad-46e5-b9cb-31b5900fcd2d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:59.530996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed8d9837-61ad-46e5-b9cb-31b5900fcd2d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:59.531432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed8d9837-61ad-46e5-b9cb-31b5900fcd2d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:59.623825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-ed8d9837-61ad-46e5-b9cb-31b5900fcd2d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lazy-loading 'services' on Instance uuid cabb9c79-5e8d-4982-a6eb-4169e2471b27 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:41:59.884983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ed8d9837-61ad-46e5-b9cb-31b5900fcd2d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/os-volume_attachments/0dc0f0a1-78b3-465b-a0b7-47050eba15eb" status: 202 len: 0 microversion: 2.1 time: 0.371071 Nov 08 17:41:59.887870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 312/650] 10.222.0.18 () {58 vars in 1415 bytes} [Mon Nov 8 17:41:59 2021] DELETE /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/os-volume_attachments/0dc0f0a1-78b3-465b-a0b7-47050eba15eb => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:41:59.890750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:41:59.891713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:41:59.898067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:59.898805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:41:59.899737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:41:59.900160 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:00.047828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [None req-9fa415dc-8130-4607-80d5-ad799dee3337 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] [83a2ba09-7aa0-4dcd-99a8-67aaaadf900f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45418. Nov 08 17:42:00.055442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:00.069637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:00.071308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:00.072489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-98a307db-db4f-4233-88d0-6549e7faf181 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.185640 Nov 08 17:42:00.073054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 313/651] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:41:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:42:00.087191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-366862d9-9ce1-475c-9a72-12ad340f18cf req-6b545c4b-8c3d-4d60-80a0-0be4fefda633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a509ca1b-3060-40c0-a623-4bad45e34fe0", "name": "network-vif-deleted", "tag": "ae841737-f79a-469b-939f-93ef0f922140"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:42:00.089115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:42:00.089115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:42:00.104854 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-366862d9-9ce1-475c-9a72-12ad340f18cf req-6b545c4b-8c3d-4d60-80a0-0be4fefda633 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:00.105197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-366862d9-9ce1-475c-9a72-12ad340f18cf req-6b545c4b-8c3d-4d60-80a0-0be4fefda633 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:00.128245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-366862d9-9ce1-475c-9a72-12ad340f18cf req-6b545c4b-8c3d-4d60-80a0-0be4fefda633 service nova] Creating event network-vif-deleted:ae841737-f79a-469b-939f-93ef0f922140 for instance a509ca1b-3060-40c0-a623-4bad45e34fe0 on hv-cinder-81689 Nov 08 17:42:00.138279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-366862d9-9ce1-475c-9a72-12ad340f18cf req-6b545c4b-8c3d-4d60-80a0-0be4fefda633 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063954 Nov 08 17:42:00.138801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 314/652] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:42:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:00.148996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:00.149803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:00.156330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:00.160302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:00.160302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:00.160302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:00.190406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:00.190878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:00.191322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lazy-loading 'fault' on Instance uuid a509ca1b-3060-40c0-a623-4bad45e34fe0 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:42:00.232743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:00.242179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-68bca354-cb6f-4937-8571-256a3f2f6621 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 200 len: 1307 microversion: 2.1 time: 0.102283 Nov 08 17:42:00.242962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 315/653] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:00 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:00.364962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-9fa415dc-8130-4607-80d5-ad799dee3337 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] Getting quotas for project 73b0bab426434f0d9854b7cabc176390. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:42:00.368805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-9fa415dc-8130-4607-80d5-ad799dee3337 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] Getting quotas for user 77642cbabeff424ba9fe2bbcf68530e7 and project 73b0bab426434f0d9854b7cabc176390. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:42:00.383437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9fa415dc-8130-4607-80d5-ad799dee3337 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.566371 Nov 08 17:42:00.384037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 339/654] 10.222.0.18 () {60 vars in 1157 bytes} [Mon Nov 8 17:41:58 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:00.537275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-941d6232-4e06-4c98-bb6b-650dcdef7af8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:00.537856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-941d6232-4e06-4c98-bb6b-650dcdef7af8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:00.547406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-941d6232-4e06-4c98-bb6b-650dcdef7af8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:00.547844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-941d6232-4e06-4c98-bb6b-650dcdef7af8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:00.548806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-941d6232-4e06-4c98-bb6b-650dcdef7af8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:00.549573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-941d6232-4e06-4c98-bb6b-650dcdef7af8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:00.699544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-941d6232-4e06-4c98-bb6b-650dcdef7af8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:00.709443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-941d6232-4e06-4c98-bb6b-650dcdef7af8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1517 microversion: 2.1 time: 0.174491 Nov 08 17:42:00.709443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 316/655] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:42:01.092679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:01.093684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:01.101539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:01.101983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:01.102782 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:01.103216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:01.255170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:01.265334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:01.265536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:01.267596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: a509ca1b-3060-40c0-a623-4bad45e34fe0] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:01.267849 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:01.268931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f8cfa427-446b-46bb-8ee6-be89f0b72b59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.180690 Nov 08 17:42:01.269488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 340/656] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:42:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:42:01.273710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:01.274221 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:01.275099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:01.276285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:01.290497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] HTTP exception thrown: Instance a509ca1b-3060-40c0-a623-4bad45e34fe0 could not be found. Nov 08 17:42:01.291118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Returning 404 to user: Instance a509ca1b-3060-40c0-a623-4bad45e34fe0 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:42:01.291933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-05bf7343-1613-413b-984f-6268f05b2443 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0" status: 404 len: 111 microversion: 2.1 time: 0.030435 Nov 08 17:42:01.293082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 317/657] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:01 2021] GET /compute/v2.1/servers/a509ca1b-3060-40c0-a623-4bad45e34fe0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 17:42:01.428482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-1a7e4c70-8600-4452-8a60-a56a45885e6c req-4df637b1-598a-41cf-9e5a-daef93f8cfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf21b3ca-51f1-43c5-9b61-78422c205ff1", "name": "network-vif-plugged", "status": "completed", "tag": "fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:42:01.430047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:42:01.430047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:42:01.442423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-1a7e4c70-8600-4452-8a60-a56a45885e6c req-4df637b1-598a-41cf-9e5a-daef93f8cfc0 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:01.442423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-1a7e4c70-8600-4452-8a60-a56a45885e6c req-4df637b1-598a-41cf-9e5a-daef93f8cfc0 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:01.450229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-1a7e4c70-8600-4452-8a60-a56a45885e6c req-4df637b1-598a-41cf-9e5a-daef93f8cfc0 service nova] Creating event network-vif-plugged:fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12 for instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 on hv-cinder-81689 Nov 08 17:42:01.455624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-1a7e4c70-8600-4452-8a60-a56a45885e6c req-4df637b1-598a-41cf-9e5a-daef93f8cfc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Nov 08 17:42:01.456221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 341/658] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:42:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:02.287093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:02.287692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:02.351754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:02.352546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:02.353333 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:02.353764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:02.530667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:02.540962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:02.544910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:02.546129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-46985f48-8d60-4952-92fd-44f004ef3af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.263045 Nov 08 17:42:02.546934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 318/659] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:42:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:42:02.722510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-191733a5-ef00-4eed-8536-6caffd71af43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:02.723452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-191733a5-ef00-4eed-8536-6caffd71af43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:02.733597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-191733a5-ef00-4eed-8536-6caffd71af43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:02.733597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-191733a5-ef00-4eed-8536-6caffd71af43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:02.733597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-191733a5-ef00-4eed-8536-6caffd71af43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:02.733597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-191733a5-ef00-4eed-8536-6caffd71af43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:02.741439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4d49307d-86d6-46af-9b20-44ffc2237fe2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:02.742108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4d49307d-86d6-46af-9b20-44ffc2237fe2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:02.748470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4d49307d-86d6-46af-9b20-44ffc2237fe2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:02.748919 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4d49307d-86d6-46af-9b20-44ffc2237fe2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:02.749702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4d49307d-86d6-46af-9b20-44ffc2237fe2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:02.750133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4d49307d-86d6-46af-9b20-44ffc2237fe2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:02.775400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4d49307d-86d6-46af-9b20-44ffc2237fe2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Going to try to terminate instance {{(pid=127763) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:42:02.913193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-191733a5-ef00-4eed-8536-6caffd71af43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:02.923353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-191733a5-ef00-4eed-8536-6caffd71af43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1517 microversion: 2.1 time: 0.205958 Nov 08 17:42:02.923956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 342/660] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:02.939888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7f17bd3d-96b6-4caf-ba3c-bf436664439f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f54de683-58ee-4fdd-b244-ddf98021e64d"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:42:02.941137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7f17bd3d-96b6-4caf-ba3c-bf436664439f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:02.956395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7f17bd3d-96b6-4caf-ba3c-bf436664439f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:02.956859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7f17bd3d-96b6-4caf-ba3c-bf436664439f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:02.957686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7f17bd3d-96b6-4caf-ba3c-bf436664439f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:02.958176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7f17bd3d-96b6-4caf-ba3c-bf436664439f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:03.206828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4d49307d-86d6-46af-9b20-44ffc2237fe2 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 204 len: 0 microversion: 2.1 time: 0.469182 Nov 08 17:42:03.207422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 319/661] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:42:02 2021] DELETE /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 08 17:42:03.215496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a148b501-40ec-4484-ac62-1513f4f9ca84 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:03.216233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a148b501-40ec-4484-ac62-1513f4f9ca84 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:03.223185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a148b501-40ec-4484-ac62-1513f4f9ca84 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:03.223628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a148b501-40ec-4484-ac62-1513f4f9ca84 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:03.224401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a148b501-40ec-4484-ac62-1513f4f9ca84 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:03.224830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a148b501-40ec-4484-ac62-1513f4f9ca84 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:03.358454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a148b501-40ec-4484-ac62-1513f4f9ca84 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:03.365595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a148b501-40ec-4484-ac62-1513f4f9ca84 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1513 microversion: 2.1 time: 0.153985 Nov 08 17:42:03.366204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 320/662] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:03 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:42:03.564785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:03.565376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:03.571168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:03.571606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:03.572361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:03.572787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:03.713261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:03.723923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:03.725430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:03.726681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0db4ab8f-1c90-4b83-aac7-a50ae881abc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.165465 Nov 08 17:42:03.727237 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 321/663] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:42:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:42:03.740254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7f17bd3d-96b6-4caf-ba3c-bf436664439f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.804273 Nov 08 17:42:03.741547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 343/664] 10.222.0.18 () {60 vars in 1322 bytes} [Mon Nov 8 17:42:02 2021] POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 194 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:42:04.383836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6d726bb4-0ab7-42d7-a4fa-ef31000d6b0e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:04.384349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6d726bb4-0ab7-42d7-a4fa-ef31000d6b0e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:04.391547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d726bb4-0ab7-42d7-a4fa-ef31000d6b0e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:04.391986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d726bb4-0ab7-42d7-a4fa-ef31000d6b0e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:04.392790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d726bb4-0ab7-42d7-a4fa-ef31000d6b0e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:04.393652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d726bb4-0ab7-42d7-a4fa-ef31000d6b0e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:04.573684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6d726bb4-0ab7-42d7-a4fa-ef31000d6b0e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:04.582689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6d726bb4-0ab7-42d7-a4fa-ef31000d6b0e tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1513 microversion: 2.1 time: 0.202739 Nov 08 17:42:04.583486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 322/665] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:04 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:04.746335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:04.747340 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:04.754065 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:04.754524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:04.755285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:04.755710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:04.897304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:04.906515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:04.908018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:04.909382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-76214f12-e617-420d-82a6-5f37d2362e18 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1806 microversion: 2.20 time: 0.167912 Nov 08 17:42:04.909941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 344/666] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:42:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:42:05.599996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-752e4b5f-fa8c-4eee-a1d9-5f5f139ee671 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:05.600676 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-752e4b5f-fa8c-4eee-a1d9-5f5f139ee671 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:05.607661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-752e4b5f-fa8c-4eee-a1d9-5f5f139ee671 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:05.608332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-752e4b5f-fa8c-4eee-a1d9-5f5f139ee671 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:05.609161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-752e4b5f-fa8c-4eee-a1d9-5f5f139ee671 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:05.609595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-752e4b5f-fa8c-4eee-a1d9-5f5f139ee671 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:05.852450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-752e4b5f-fa8c-4eee-a1d9-5f5f139ee671 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:05.859875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-752e4b5f-fa8c-4eee-a1d9-5f5f139ee671 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1513 microversion: 2.1 time: 0.263927 Nov 08 17:42:05.860621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 323/667] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:05 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:05.927694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:05.928301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:05.934892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:05.935345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:05.936133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:05.936569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:06.133103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-02a0d6e6-0c09-4262-a496-a6281c9f4d19 req-966d5ee0-ca5e-4ec2-9d33-0a0b86446a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32522c32-1bb6-42e0-aa78-570cdaebad68", "name": "network-vif-deleted", "tag": "26667ea0-97f1-4e86-8cff-b07308a44cf1"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:42:06.134729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:42:06.134729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:42:06.142372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-02a0d6e6-0c09-4262-a496-a6281c9f4d19 req-966d5ee0-ca5e-4ec2-9d33-0a0b86446a4f service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:06.143243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-02a0d6e6-0c09-4262-a496-a6281c9f4d19 req-966d5ee0-ca5e-4ec2-9d33-0a0b86446a4f service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:06.144474 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:06.153426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:06.154945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:06.165686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f99dccdd-bbaa-4f21-a52e-7f9a1a1352f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1793 microversion: 2.20 time: 0.232597 Nov 08 17:42:06.165686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 345/668] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:42:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1793 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:42:06.165908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-02a0d6e6-0c09-4262-a496-a6281c9f4d19 req-966d5ee0-ca5e-4ec2-9d33-0a0b86446a4f service nova] Creating event network-vif-deleted:26667ea0-97f1-4e86-8cff-b07308a44cf1 for instance 32522c32-1bb6-42e0-aa78-570cdaebad68 on hv-cinder-81689 Nov 08 17:42:06.170695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-02a0d6e6-0c09-4262-a496-a6281c9f4d19 req-966d5ee0-ca5e-4ec2-9d33-0a0b86446a4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041206 Nov 08 17:42:06.171280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 324/669] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:42:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:42:06.877931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:06.878185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:06.884054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:06.884494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:06.885258 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:06.885702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:06.916399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:06.916844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:06.917294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lazy-loading 'fault' on Instance uuid 32522c32-1bb6-42e0-aa78-570cdaebad68 {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:42:06.958001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca86df4b2b6476fae354e9e96fbdf53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1c05515852427e84b12522c50545fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:06.966199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4230358b-53f9-4c19-a243-cd8bd311ca90 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 200 len: 1307 microversion: 2.1 time: 0.092310 Nov 08 17:42:06.976423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 346/670] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:06 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:07.985038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:07.985744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] [instance: 32522c32-1bb6-42e0-aa78-570cdaebad68] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:07.992952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:07.993392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:07.994197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:07.994657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:08.009027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] HTTP exception thrown: Instance 32522c32-1bb6-42e0-aa78-570cdaebad68 could not be found. Nov 08 17:42:08.009628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] Returning 404 to user: Instance 32522c32-1bb6-42e0-aa78-570cdaebad68 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:42:08.010437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e561075b-a294-47fc-bf98-23486ddddf24 tempest-AttachVolumeNegativeTest-376540528 tempest-AttachVolumeNegativeTest-376540528-project] 10.222.0.18 "GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68" status: 404 len: 111 microversion: 2.1 time: 0.030281 Nov 08 17:42:08.011195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 325/671] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:07 2021] GET /compute/v2.1/servers/32522c32-1bb6-42e0-aa78-570cdaebad68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:42:08.421843 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a4d15b42-e725-48b7-9ee0-cf5e2e273c26 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:42:08.429236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4d15b42-e725-48b7-9ee0-cf5e2e273c26 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:08.429677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4d15b42-e725-48b7-9ee0-cf5e2e273c26 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:08.451441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a4d15b42-e725-48b7-9ee0-cf5e2e273c26 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Going to try to stop instance {{(pid=127762) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 08 17:42:08.672194 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a4d15b42-e725-48b7-9ee0-cf5e2e273c26 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 202 len: 0 microversion: 2.1 time: 0.253853 Nov 08 17:42:08.672836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 347/672] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:42:08 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:42:08.681387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b6a29af2-bd0b-4131-aae9-97f88e25672c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:08.681986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b6a29af2-bd0b-4131-aae9-97f88e25672c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:08.688037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6a29af2-bd0b-4131-aae9-97f88e25672c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:08.688476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6a29af2-bd0b-4131-aae9-97f88e25672c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:08.689236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6a29af2-bd0b-4131-aae9-97f88e25672c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:08.689697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6a29af2-bd0b-4131-aae9-97f88e25672c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:08.836303 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b6a29af2-bd0b-4131-aae9-97f88e25672c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:08.843812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b6a29af2-bd0b-4131-aae9-97f88e25672c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.166020 Nov 08 17:42:08.844378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 326/673] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:08 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:09.862428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ca33300e-17fe-4549-912b-fc5939dbb521 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:09.863195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ca33300e-17fe-4549-912b-fc5939dbb521 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:09.869985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca33300e-17fe-4549-912b-fc5939dbb521 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:09.870719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca33300e-17fe-4549-912b-fc5939dbb521 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:09.871519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca33300e-17fe-4549-912b-fc5939dbb521 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:09.871957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca33300e-17fe-4549-912b-fc5939dbb521 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:10.007003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ca33300e-17fe-4549-912b-fc5939dbb521 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:10.015019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ca33300e-17fe-4549-912b-fc5939dbb521 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.157498 Nov 08 17:42:10.018621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 348/674] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:09 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:10.589288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6766f187-1ae4-4b02-80d6-7df155d8a8b3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Action: 'create', calling method: .version_select at 0x7f06ec31ce50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1534025607", "metadata": {"Type": "work"}}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:42:11.033929 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-eceef049-ac35-4934-a3dd-7cca9918715b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:11.034584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-eceef049-ac35-4934-a3dd-7cca9918715b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:11.040812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eceef049-ac35-4934-a3dd-7cca9918715b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:11.041251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eceef049-ac35-4934-a3dd-7cca9918715b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:11.042012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eceef049-ac35-4934-a3dd-7cca9918715b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:11.042437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eceef049-ac35-4934-a3dd-7cca9918715b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:11.177457 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-eceef049-ac35-4934-a3dd-7cca9918715b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:11.185014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-eceef049-ac35-4934-a3dd-7cca9918715b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.155385 Nov 08 17:42:11.185591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 349/675] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:11 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:42:11.310380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6766f187-1ae4-4b02-80d6-7df155d8a8b3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.836417 Nov 08 17:42:11.313633 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 327/676] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Nov 8 17:42:10 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 840 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 08 17:42:11.324973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a165037b-4111-4352-9b3a-7ac608ecde32 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37ca60>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:11.371123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a165037b-4111-4352-9b3a-7ac608ecde32 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049683 Nov 08 17:42:11.371694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 350/677] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:11 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:12.202825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-141dbf7a-09fb-4e76-b879-150022f0128b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:12.203379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-141dbf7a-09fb-4e76-b879-150022f0128b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:12.216857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-141dbf7a-09fb-4e76-b879-150022f0128b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:12.216857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-141dbf7a-09fb-4e76-b879-150022f0128b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:12.216857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-141dbf7a-09fb-4e76-b879-150022f0128b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:12.216857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-141dbf7a-09fb-4e76-b879-150022f0128b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:12.346219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-141dbf7a-09fb-4e76-b879-150022f0128b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:12.353948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-141dbf7a-09fb-4e76-b879-150022f0128b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.155305 Nov 08 17:42:12.354753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 328/678] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:12 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:12.384409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-08e7dbcc-918c-48fa-87ee-32711fdb9b27 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec55fd30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:12.430423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-08e7dbcc-918c-48fa-87ee-32711fdb9b27 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 354 microversion: 2.1 time: 0.050487 Nov 08 17:42:12.431019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 351/679] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:12.442750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d90887da-d1dd-49a1-88aa-40b34edff505 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec390160>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:12.489146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d90887da-d1dd-49a1-88aa-40b34edff505 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 354 microversion: 2.1 time: 0.050600 Nov 08 17:42:12.489715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 329/680] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:42:12.506498 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1ea6113e-af6c-4755-9d8a-5f6ba94023a9 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3355e0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:12.703010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1ea6113e-af6c-4755-9d8a-5f6ba94023a9 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 202 len: 0 microversion: 2.1 time: 0.200047 Nov 08 17:42:12.703655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 352/681] 10.222.0.18 () {58 vars in 1247 bytes} [Mon Nov 8 17:42:12 2021] DELETE /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:42:12.711483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6cfbbfd2-6b89-4452-842c-db0251476c73 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec33cd30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:12.756729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6cfbbfd2-6b89-4452-842c-db0251476c73 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048828 Nov 08 17:42:12.759583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 330/682] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:13.370602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b37196cd-5b9c-421f-b40c-60311d042e9f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:13.371226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b37196cd-5b9c-421f-b40c-60311d042e9f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:13.377138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b37196cd-5b9c-421f-b40c-60311d042e9f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:13.377667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b37196cd-5b9c-421f-b40c-60311d042e9f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:13.378535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b37196cd-5b9c-421f-b40c-60311d042e9f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:13.379037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b37196cd-5b9c-421f-b40c-60311d042e9f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:13.508470 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b37196cd-5b9c-421f-b40c-60311d042e9f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:13.515656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b37196cd-5b9c-421f-b40c-60311d042e9f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.149193 Nov 08 17:42:13.516247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 353/683] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:13 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:13.770087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-093b6461-bfdf-420c-bbf4-2766653b26b3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e8820>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:13.816208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-093b6461-bfdf-420c-bbf4-2766653b26b3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050175 Nov 08 17:42:13.817068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 331/684] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:13 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:14.537906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e5bd5d52-02fa-477f-ba24-86ffebba05a7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:14.538726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e5bd5d52-02fa-477f-ba24-86ffebba05a7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:14.546991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5bd5d52-02fa-477f-ba24-86ffebba05a7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:14.547461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5bd5d52-02fa-477f-ba24-86ffebba05a7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:14.548376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5bd5d52-02fa-477f-ba24-86ffebba05a7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:14.548813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5bd5d52-02fa-477f-ba24-86ffebba05a7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:14.680850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e5bd5d52-02fa-477f-ba24-86ffebba05a7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:14.688078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e5bd5d52-02fa-477f-ba24-86ffebba05a7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.155344 Nov 08 17:42:14.688685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 354/685] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:14 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:14.829054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7548e9cd-ebb3-4f6d-a541-ee86ccdc5e6f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec33c550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:14.873153 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7548e9cd-ebb3-4f6d-a541-ee86ccdc5e6f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048084 Nov 08 17:42:14.873742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 332/686] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:14 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:15.705058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bb06ef28-e29c-4d1a-b6ad-357c835a410e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:15.705599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bb06ef28-e29c-4d1a-b6ad-357c835a410e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:15.712306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb06ef28-e29c-4d1a-b6ad-357c835a410e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:15.712750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb06ef28-e29c-4d1a-b6ad-357c835a410e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:15.713517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb06ef28-e29c-4d1a-b6ad-357c835a410e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:15.713948 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb06ef28-e29c-4d1a-b6ad-357c835a410e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:15.840378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bb06ef28-e29c-4d1a-b6ad-357c835a410e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:15.848434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bb06ef28-e29c-4d1a-b6ad-357c835a410e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.147124 Nov 08 17:42:15.849002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 355/687] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:15 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:15.885613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-064889f8-2d16-4f5e-a269-886d35a97974 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e8670>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:15.930475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-064889f8-2d16-4f5e-a269-886d35a97974 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048769 Nov 08 17:42:15.931035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 333/688] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:15 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:16.866047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0f621a33-f1ee-4f40-bf7a-f7daa1d265b9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:16.866710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0f621a33-f1ee-4f40-bf7a-f7daa1d265b9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:16.873325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f621a33-f1ee-4f40-bf7a-f7daa1d265b9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:16.873772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f621a33-f1ee-4f40-bf7a-f7daa1d265b9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:16.874574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f621a33-f1ee-4f40-bf7a-f7daa1d265b9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:16.875007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f621a33-f1ee-4f40-bf7a-f7daa1d265b9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:16.943420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c9e9bdc7-c363-4fee-ac81-e9d9fc9ea55c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd3a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:16.990522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c9e9bdc7-c363-4fee-ac81-e9d9fc9ea55c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051227 Nov 08 17:42:16.991093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 334/689] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:16 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:42:17.009299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0f621a33-f1ee-4f40-bf7a-f7daa1d265b9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:17.016617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0f621a33-f1ee-4f40-bf7a-f7daa1d265b9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.154813 Nov 08 17:42:17.017176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 356/690] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:16 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:18.004131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4cb7e6e4-fec6-4aa5-bb7a-693c3d3c08aa tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec390430>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:18.033949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8c85d4ef-1669-4947-b184-d83e12db8503 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:18.034698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8c85d4ef-1669-4947-b184-d83e12db8503 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:18.041527 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8c85d4ef-1669-4947-b184-d83e12db8503 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:18.042214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8c85d4ef-1669-4947-b184-d83e12db8503 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:18.043033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8c85d4ef-1669-4947-b184-d83e12db8503 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:18.043469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8c85d4ef-1669-4947-b184-d83e12db8503 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:18.053523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4cb7e6e4-fec6-4aa5-bb7a-693c3d3c08aa tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053809 Nov 08 17:42:18.054600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 335/691] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:17 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:18.177337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8c85d4ef-1669-4947-b184-d83e12db8503 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:18.184616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8c85d4ef-1669-4947-b184-d83e12db8503 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.154496 Nov 08 17:42:18.185172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 357/692] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:18 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:42:19.068101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-12ceb34c-2f79-49a5-a1df-8f19cdbfcb43 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec345550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:19.112298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-12ceb34c-2f79-49a5-a1df-8f19cdbfcb43 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048692 Nov 08 17:42:19.112911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 336/693] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:19 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:19.201219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-86f31675-b70a-4d97-8a70-28f2a4a507ad tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:19.201747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-86f31675-b70a-4d97-8a70-28f2a4a507ad tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:19.207979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86f31675-b70a-4d97-8a70-28f2a4a507ad tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:19.208423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86f31675-b70a-4d97-8a70-28f2a4a507ad tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:19.209189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86f31675-b70a-4d97-8a70-28f2a4a507ad tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:19.209622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86f31675-b70a-4d97-8a70-28f2a4a507ad tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:19.335958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-86f31675-b70a-4d97-8a70-28f2a4a507ad tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:19.343223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-86f31675-b70a-4d97-8a70-28f2a4a507ad tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.145689 Nov 08 17:42:19.343792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 358/694] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:19 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:20.125620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-76688dcb-6742-440e-9110-0b229e0175d5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2db280>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:20.172618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-76688dcb-6742-440e-9110-0b229e0175d5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050914 Nov 08 17:42:20.173192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 337/695] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:20 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:20.360873 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-08f62688-0d8e-461a-a6d2-cd225654e4d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:20.361434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-08f62688-0d8e-461a-a6d2-cd225654e4d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:20.368522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-08f62688-0d8e-461a-a6d2-cd225654e4d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:20.368970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-08f62688-0d8e-461a-a6d2-cd225654e4d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:20.369736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-08f62688-0d8e-461a-a6d2-cd225654e4d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:20.370438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-08f62688-0d8e-461a-a6d2-cd225654e4d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:20.501274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-08f62688-0d8e-461a-a6d2-cd225654e4d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:20.508488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-08f62688-0d8e-461a-a6d2-cd225654e4d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.151344 Nov 08 17:42:20.509044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 359/696] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:20 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:21.185057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-643765b8-212b-4ff8-b8df-fd68dbf8ad55 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec723790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:21.229786 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-643765b8-212b-4ff8-b8df-fd68dbf8ad55 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048706 Nov 08 17:42:21.230396 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 338/697] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:21 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:21.524892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d420fdec-dc55-476e-a2c8-531fc70c5deb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:21.525500 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d420fdec-dc55-476e-a2c8-531fc70c5deb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:21.531754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d420fdec-dc55-476e-a2c8-531fc70c5deb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:21.532197 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d420fdec-dc55-476e-a2c8-531fc70c5deb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:21.532965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d420fdec-dc55-476e-a2c8-531fc70c5deb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:21.533401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d420fdec-dc55-476e-a2c8-531fc70c5deb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:21.664311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d420fdec-dc55-476e-a2c8-531fc70c5deb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:21.671659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d420fdec-dc55-476e-a2c8-531fc70c5deb tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.150440 Nov 08 17:42:21.672231 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 360/698] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:21 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:22.242916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4d391b3a-f00a-428a-a777-0cf8fcc766e8 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec45dca0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:22.294101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4d391b3a-f00a-428a-a777-0cf8fcc766e8 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.055958 Nov 08 17:42:22.294769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 339/699] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:22 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:22.726402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a7c0e496-08b5-4a5e-a296-185f859784fa tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:22.727030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a7c0e496-08b5-4a5e-a296-185f859784fa tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:22.733451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a7c0e496-08b5-4a5e-a296-185f859784fa tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:22.733898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a7c0e496-08b5-4a5e-a296-185f859784fa tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:22.734849 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a7c0e496-08b5-4a5e-a296-185f859784fa tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:22.735123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a7c0e496-08b5-4a5e-a296-185f859784fa tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:22.863366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a7c0e496-08b5-4a5e-a296-185f859784fa tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:22.870800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a7c0e496-08b5-4a5e-a296-185f859784fa tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.147939 Nov 08 17:42:22.871356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 361/700] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:22 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:23.306874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f1c92e0a-d836-4225-9791-3f9e8201b6b4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37c550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:23.352329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f1c92e0a-d836-4225-9791-3f9e8201b6b4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049485 Nov 08 17:42:23.352896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 340/701] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:23 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:23.889948 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3eaceaa6-ebb4-47f0-9982-93e9ab55682a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:23.890582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3eaceaa6-ebb4-47f0-9982-93e9ab55682a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:23.897374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3eaceaa6-ebb4-47f0-9982-93e9ab55682a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:23.897822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3eaceaa6-ebb4-47f0-9982-93e9ab55682a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:23.898629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3eaceaa6-ebb4-47f0-9982-93e9ab55682a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:23.899066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3eaceaa6-ebb4-47f0-9982-93e9ab55682a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:24.027776 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3eaceaa6-ebb4-47f0-9982-93e9ab55682a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:24.036112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3eaceaa6-ebb4-47f0-9982-93e9ab55682a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.149600 Nov 08 17:42:24.036675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 362/702] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:23 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:24.364955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-65626fb7-d40b-4b80-855d-7fd2f7aedbe4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec33c8b0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:24.412057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-65626fb7-d40b-4b80-855d-7fd2f7aedbe4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051224 Nov 08 17:42:24.412628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 341/703] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:24 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:25.053574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f3fa81ed-75b5-4f9d-b15b-daaa04886b17 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:25.054198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f3fa81ed-75b5-4f9d-b15b-daaa04886b17 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:25.060406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3fa81ed-75b5-4f9d-b15b-daaa04886b17 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:25.060830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3fa81ed-75b5-4f9d-b15b-daaa04886b17 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:25.061581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3fa81ed-75b5-4f9d-b15b-daaa04886b17 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:25.062007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3fa81ed-75b5-4f9d-b15b-daaa04886b17 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:25.193511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f3fa81ed-75b5-4f9d-b15b-daaa04886b17 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:25.200746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f3fa81ed-75b5-4f9d-b15b-daaa04886b17 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.151481 Nov 08 17:42:25.201311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 363/704] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:25 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:25.424020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-730b26c0-d85d-419b-8aa5-ade571c5f61f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:25.469539 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-730b26c0-d85d-419b-8aa5-ade571c5f61f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049579 Nov 08 17:42:25.470097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 342/705] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:25 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:26.216777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c3c77fab-701d-4bcc-abaf-bac71059e940 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:26.217370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c3c77fab-701d-4bcc-abaf-bac71059e940 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:26.223697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c3c77fab-701d-4bcc-abaf-bac71059e940 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:26.224141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c3c77fab-701d-4bcc-abaf-bac71059e940 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:26.224903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c3c77fab-701d-4bcc-abaf-bac71059e940 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:26.225335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c3c77fab-701d-4bcc-abaf-bac71059e940 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:26.356060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c3c77fab-701d-4bcc-abaf-bac71059e940 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:26.364028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c3c77fab-701d-4bcc-abaf-bac71059e940 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1677 microversion: 2.1 time: 0.150823 Nov 08 17:42:26.364753 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 364/706] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:26 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:26.483147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9d6b2429-4784-4875-a2af-29e5d23ccaee tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37c940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:26.528525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9d6b2429-4784-4875-a2af-29e5d23ccaee tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049411 Nov 08 17:42:26.529084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 343/707] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:26 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:27.381607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-55018878-b1db-41d4-b82a-be341ecfbbb3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:27.382223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-55018878-b1db-41d4-b82a-be341ecfbbb3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:27.388509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55018878-b1db-41d4-b82a-be341ecfbbb3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:27.388952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55018878-b1db-41d4-b82a-be341ecfbbb3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:27.389720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55018878-b1db-41d4-b82a-be341ecfbbb3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:27.390151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55018878-b1db-41d4-b82a-be341ecfbbb3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:27.517272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-55018878-b1db-41d4-b82a-be341ecfbbb3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:27.524609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-55018878-b1db-41d4-b82a-be341ecfbbb3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1654 microversion: 2.1 time: 0.147234 Nov 08 17:42:27.525205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 365/708] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:27 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:27.540164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bae31576-5822-4ea0-bb8a-b8ab89f3688c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec334dc0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:27.540319 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7f5dc712-fd84-4373-8f6a-dd8b70ad3fde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:42:27.546803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7f5dc712-fd84-4373-8f6a-dd8b70ad3fde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:27.547281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7f5dc712-fd84-4373-8f6a-dd8b70ad3fde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:27.570247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7f5dc712-fd84-4373-8f6a-dd8b70ad3fde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Going to try to start instance {{(pid=127763) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 08 17:42:27.586735 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bae31576-5822-4ea0-bb8a-b8ab89f3688c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049821 Nov 08 17:42:27.587311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 366/709] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:27 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:42:27.694571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7f5dc712-fd84-4373-8f6a-dd8b70ad3fde tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action" status: 202 len: 0 microversion: 2.1 time: 0.157470 Nov 08 17:42:27.695169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 344/710] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:42:27 2021] POST /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:42:27.703098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e5d74bf0-c06f-44d3-a2c1-19d8643cd9a3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:27.703695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e5d74bf0-c06f-44d3-a2c1-19d8643cd9a3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:27.709769 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d74bf0-c06f-44d3-a2c1-19d8643cd9a3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:27.710213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d74bf0-c06f-44d3-a2c1-19d8643cd9a3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:27.711022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d74bf0-c06f-44d3-a2c1-19d8643cd9a3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:27.711459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d74bf0-c06f-44d3-a2c1-19d8643cd9a3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:27.849841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e5d74bf0-c06f-44d3-a2c1-19d8643cd9a3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:27.857271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e5d74bf0-c06f-44d3-a2c1-19d8643cd9a3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1663 microversion: 2.1 time: 0.157800 Nov 08 17:42:27.857844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 367/711] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:27 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:28.600791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-19ddbaaf-2e94-4366-a168-04c3746fde31 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec33cee0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:28.647266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-19ddbaaf-2e94-4366-a168-04c3746fde31 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051725 Nov 08 17:42:28.647826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 345/712] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:28 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:28.875148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6edc3780-2c3a-4268-96d6-ee0339f151ee tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:28.875748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6edc3780-2c3a-4268-96d6-ee0339f151ee tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:28.882627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6edc3780-2c3a-4268-96d6-ee0339f151ee tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:28.883061 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6edc3780-2c3a-4268-96d6-ee0339f151ee tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:28.883823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6edc3780-2c3a-4268-96d6-ee0339f151ee tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:28.884252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6edc3780-2c3a-4268-96d6-ee0339f151ee tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:29.018354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6edc3780-2c3a-4268-96d6-ee0339f151ee tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:29.025454 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6edc3780-2c3a-4268-96d6-ee0339f151ee tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1663 microversion: 2.1 time: 0.153923 Nov 08 17:42:29.026021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 368/713] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:28 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:29.660065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6d6c23a1-9b41-474b-8a11-0edfbeb9cc22 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3c69d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:29.703698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6d6c23a1-9b41-474b-8a11-0edfbeb9cc22 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047957 Nov 08 17:42:29.704261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 346/714] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:29 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:30.042921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-05ab7166-b40b-43ec-8bed-61b562e2bb38 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:30.043524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-05ab7166-b40b-43ec-8bed-61b562e2bb38 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:30.049853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05ab7166-b40b-43ec-8bed-61b562e2bb38 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:30.050882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05ab7166-b40b-43ec-8bed-61b562e2bb38 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:30.051870 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05ab7166-b40b-43ec-8bed-61b562e2bb38 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:30.052169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05ab7166-b40b-43ec-8bed-61b562e2bb38 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:30.186081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-05ab7166-b40b-43ec-8bed-61b562e2bb38 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:42:30.193269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-05ab7166-b40b-43ec-8bed-61b562e2bb38 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1667 microversion: 2.1 time: 0.153968 Nov 08 17:42:30.197897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 369/715] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:42:30 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:42:30.717729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a8935c93-3791-4271-83cf-27e23306194e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec345820>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:30.761869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a8935c93-3791-4271-83cf-27e23306194e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048915 Nov 08 17:42:30.762483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 347/716] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:30 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:31.774178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6a63e90c-00ba-4371-a2fa-1fe196b440c7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec55f5e0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:31.819235 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6a63e90c-00ba-4371-a2fa-1fe196b440c7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048837 Nov 08 17:42:31.819803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 370/717] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:31 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:32.838965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0869cd4b-dd77-48c7-9efc-f92d86cc9272 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec36eca0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:32.877874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0869cd4b-dd77-48c7-9efc-f92d86cc9272 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050214 Nov 08 17:42:32.879294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 348/718] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:32 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:33.892553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9f07623b-652b-433e-bbaa-8f3052a08a0d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e2f70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:33.936552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9f07623b-652b-433e-bbaa-8f3052a08a0d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047923 Nov 08 17:42:33.936982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 371/719] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:33 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:34.949211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a1c37780-3fc0-490d-ba80-bb8d8c584ff7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec33c3a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:34.994444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a1c37780-3fc0-490d-ba80-bb8d8c584ff7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049206 Nov 08 17:42:34.995306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 349/720] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:34 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:36.008259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-089874cf-2a99-4077-814d-99b550f69348 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ec790>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:36.055714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-089874cf-2a99-4077-814d-99b550f69348 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052250 Nov 08 17:42:36.056290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 372/721] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:36 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:37.069020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-215f60ed-99d2-491c-a63c-9ec387788531 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2db310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:37.113684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-215f60ed-99d2-491c-a63c-9ec387788531 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049289 Nov 08 17:42:37.114452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 350/722] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:37 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:38.126829 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0926a646-ff6a-4728-ac30-df9ed6018c93 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2af0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:38.172435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0926a646-ff6a-4728-ac30-df9ed6018c93 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049971 Nov 08 17:42:38.173007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 373/723] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:38 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:39.185189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0815f6be-e3a6-4d7b-89e4-b04872c62062 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec345700>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:39.229943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0815f6be-e3a6-4d7b-89e4-b04872c62062 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048896 Nov 08 17:42:39.230781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 351/724] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:39 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:40.243207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a5be207f-3bbc-4441-9782-5e27c0135129 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec55fe50>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:40.287660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a5be207f-3bbc-4441-9782-5e27c0135129 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049335 Nov 08 17:42:40.288219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 374/725] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:40 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:41.300193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-50a1e46f-5c9a-4f4b-8515-61953f6792e6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec33cdc0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:41.346877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-50a1e46f-5c9a-4f4b-8515-61953f6792e6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050757 Nov 08 17:42:41.348083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 352/726] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:41 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:42:42.359596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4be09e99-3e84-40cc-b40c-3ce95cd1e512 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ecc10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:42.404869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4be09e99-3e84-40cc-b40c-3ce95cd1e512 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049350 Nov 08 17:42:42.405430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 375/727] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:42 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:43.417426 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-63428e17-222d-4bd8-9096-2f5a832392c4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:43.462943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-63428e17-222d-4bd8-9096-2f5a832392c4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049640 Nov 08 17:42:43.463514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 353/728] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:43 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:44.476155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a7ad64ba-087f-4c3f-b522-ae0858bd231f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3c3ca0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:44.519973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a7ad64ba-087f-4c3f-b522-ae0858bd231f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048557 Nov 08 17:42:44.520528 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 376/729] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:44 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:45.532486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4bd96dff-507d-4e3e-9128-ae68d2fe8244 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec353af0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:45.578040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4bd96dff-507d-4e3e-9128-ae68d2fe8244 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049579 Nov 08 17:42:45.578631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 354/730] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:45 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:46.590773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6a33c14d-3962-460d-9a57-4b9c4b9bd6c3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec371af0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:46.635798 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6a33c14d-3962-460d-9a57-4b9c4b9bd6c3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049042 Nov 08 17:42:46.636367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 377/731] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:46 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:47.466323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2e36ab0f-9b91-4afd-89c2-22271bd04226 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:47.466957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2e36ab0f-9b91-4afd-89c2-22271bd04226 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:47.473743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2e36ab0f-9b91-4afd-89c2-22271bd04226 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:47.474225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2e36ab0f-9b91-4afd-89c2-22271bd04226 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:47.475027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2e36ab0f-9b91-4afd-89c2-22271bd04226 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:47.475460 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2e36ab0f-9b91-4afd-89c2-22271bd04226 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:47.502516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2e36ab0f-9b91-4afd-89c2-22271bd04226 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments/fc01a120-8edd-4c4a-94da-0409ed7b64e2" status: 200 len: 194 microversion: 2.20 time: 0.040439 Nov 08 17:42:47.503094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 355/732] 10.222.0.18 () {60 vars in 1453 bytes} [Mon Nov 8 17:42:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments/fc01a120-8edd-4c4a-94da-0409ed7b64e2 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:47.564985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c3ddab9e-2ac0-4eec-a9b8-e036f8dd04c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:47.565469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c3ddab9e-2ac0-4eec-a9b8-e036f8dd04c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:47.573614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c3ddab9e-2ac0-4eec-a9b8-e036f8dd04c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:47.574239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c3ddab9e-2ac0-4eec-a9b8-e036f8dd04c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:47.575042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c3ddab9e-2ac0-4eec-a9b8-e036f8dd04c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:47.575467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c3ddab9e-2ac0-4eec-a9b8-e036f8dd04c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:47.648493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f3bfebb4-12d1-444c-b148-59903f93b893 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3a6310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:47.657779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-c3ddab9e-2ac0-4eec-a9b8-e036f8dd04c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lazy-loading 'services' on Instance uuid cf21b3ca-51f1-43c5-9b61-78422c205ff1 {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:42:47.694097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f3bfebb4-12d1-444c-b148-59903f93b893 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049805 Nov 08 17:42:47.694692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 356/733] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:47 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:42:47.906832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c3ddab9e-2ac0-4eec-a9b8-e036f8dd04c2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments/fc01a120-8edd-4c4a-94da-0409ed7b64e2" status: 202 len: 0 microversion: 2.20 time: 0.345275 Nov 08 17:42:47.907416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 378/734] 10.222.0.18 () {60 vars in 1456 bytes} [Mon Nov 8 17:42:47 2021] DELETE /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments/fc01a120-8edd-4c4a-94da-0409ed7b64e2 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:42:47.915717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f8df091b-118b-4383-b22c-82c26e6b628b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:47.916677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f8df091b-118b-4383-b22c-82c26e6b628b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:47.922345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8df091b-118b-4383-b22c-82c26e6b628b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:47.922814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8df091b-118b-4383-b22c-82c26e6b628b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:47.923581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8df091b-118b-4383-b22c-82c26e6b628b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:47.924005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8df091b-118b-4383-b22c-82c26e6b628b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:47.953642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f8df091b-118b-4383-b22c-82c26e6b628b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041602 Nov 08 17:42:47.954194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 357/735] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:42:48.708048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7a2a9ebc-8064-4322-925b-c0a27cf7fe32 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ec670>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:48.753232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7a2a9ebc-8064-4322-925b-c0a27cf7fe32 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050168 Nov 08 17:42:48.753912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 379/736] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:48 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:48.965803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-70e313d1-ce48-4ad0-902a-ab3794792fe7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:48.966667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-70e313d1-ce48-4ad0-902a-ab3794792fe7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:48.972806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-70e313d1-ce48-4ad0-902a-ab3794792fe7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:48.973425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-70e313d1-ce48-4ad0-902a-ab3794792fe7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:48.974093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-70e313d1-ce48-4ad0-902a-ab3794792fe7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:48.974541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-70e313d1-ce48-4ad0-902a-ab3794792fe7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:49.006033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-70e313d1-ce48-4ad0-902a-ab3794792fe7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043924 Nov 08 17:42:49.006629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 358/737] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:49.766084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6c1be027-631d-401d-aab1-20e8a67dbc06 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec335f70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:49.811257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6c1be027-631d-401d-aab1-20e8a67dbc06 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049198 Nov 08 17:42:49.811814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 380/738] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:49 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:50.017483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-96cb02e8-3863-43d3-9263-6feb36cb41fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:50.018317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-96cb02e8-3863-43d3-9263-6feb36cb41fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:50.025058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96cb02e8-3863-43d3-9263-6feb36cb41fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:50.025497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96cb02e8-3863-43d3-9263-6feb36cb41fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:50.026258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96cb02e8-3863-43d3-9263-6feb36cb41fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:50.026725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96cb02e8-3863-43d3-9263-6feb36cb41fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:50.055877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-96cb02e8-3863-43d3-9263-6feb36cb41fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042207 Nov 08 17:42:50.056431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 359/739] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:50.824678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c23acf37-8236-48c0-8b55-8b231bbf48ca tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e2c10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:50.871328 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c23acf37-8236-48c0-8b55-8b231bbf48ca tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050767 Nov 08 17:42:50.871935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 381/740] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:50 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:51.067878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8d661e81-abc5-4a6c-806b-8f3c4e8c22ad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:51.068808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8d661e81-abc5-4a6c-806b-8f3c4e8c22ad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:51.074993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d661e81-abc5-4a6c-806b-8f3c4e8c22ad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:51.075375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d661e81-abc5-4a6c-806b-8f3c4e8c22ad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:51.076143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d661e81-abc5-4a6c-806b-8f3c4e8c22ad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:51.076572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d661e81-abc5-4a6c-806b-8f3c4e8c22ad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:51.105120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8d661e81-abc5-4a6c-806b-8f3c4e8c22ad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041487 Nov 08 17:42:51.105676 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 360/741] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:51.884384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5d715e88-0fd4-41ed-87e1-ff8dfdc4583f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2d30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:51.931088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5d715e88-0fd4-41ed-87e1-ff8dfdc4583f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049219 Nov 08 17:42:51.931088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 382/742] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:51 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:52.117988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-52b0904b-43d3-4d33-bac3-c2ecd6a0fd8f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:52.118935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-52b0904b-43d3-4d33-bac3-c2ecd6a0fd8f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:52.125337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52b0904b-43d3-4d33-bac3-c2ecd6a0fd8f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:52.125782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52b0904b-43d3-4d33-bac3-c2ecd6a0fd8f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:52.126570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52b0904b-43d3-4d33-bac3-c2ecd6a0fd8f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:52.127012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52b0904b-43d3-4d33-bac3-c2ecd6a0fd8f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:52.155353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-52b0904b-43d3-4d33-bac3-c2ecd6a0fd8f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041843 Nov 08 17:42:52.155914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 361/743] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:52.941133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c234f8cf-e587-4ae8-9a0d-aaa66237c6df tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec6f4430>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:52.987895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c234f8cf-e587-4ae8-9a0d-aaa66237c6df tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050184 Nov 08 17:42:52.994854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 383/744] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:52 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:53.167202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2851fe65-5d58-40d1-91b6-8deff3200778 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:53.168128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2851fe65-5d58-40d1-91b6-8deff3200778 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:53.174338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2851fe65-5d58-40d1-91b6-8deff3200778 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:53.174985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2851fe65-5d58-40d1-91b6-8deff3200778 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:53.176007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2851fe65-5d58-40d1-91b6-8deff3200778 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:53.176481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2851fe65-5d58-40d1-91b6-8deff3200778 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:53.206626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2851fe65-5d58-40d1-91b6-8deff3200778 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043298 Nov 08 17:42:53.207862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 362/745] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:54.001418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c0d5f847-94cd-4022-9f6f-2a4b8475405c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3734c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:54.047249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c0d5f847-94cd-4022-9f6f-2a4b8475405c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049942 Nov 08 17:42:54.047817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 384/746] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:53 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:54.219419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dff587b9-0c10-4c3b-ab3e-e4fbd96c99d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:54.220239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dff587b9-0c10-4c3b-ab3e-e4fbd96c99d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:54.227147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dff587b9-0c10-4c3b-ab3e-e4fbd96c99d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:54.227592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dff587b9-0c10-4c3b-ab3e-e4fbd96c99d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:54.228386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dff587b9-0c10-4c3b-ab3e-e4fbd96c99d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:54.228813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dff587b9-0c10-4c3b-ab3e-e4fbd96c99d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:54.257975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dff587b9-0c10-4c3b-ab3e-e4fbd96c99d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042341 Nov 08 17:42:54.258564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 363/747] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:55.060191 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-af3267f1-f2e4-40a5-8838-3120d3bbbe81 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec378ca0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:55.105210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-af3267f1-f2e4-40a5-8838-3120d3bbbe81 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049020 Nov 08 17:42:55.105823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 385/748] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:55 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:55.269426 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-815a8b92-28b4-4297-8413-7a269e603c39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:55.270493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-815a8b92-28b4-4297-8413-7a269e603c39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:55.276631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-815a8b92-28b4-4297-8413-7a269e603c39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:55.277073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-815a8b92-28b4-4297-8413-7a269e603c39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:55.277837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-815a8b92-28b4-4297-8413-7a269e603c39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:55.278266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-815a8b92-28b4-4297-8413-7a269e603c39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:55.306703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-815a8b92-28b4-4297-8413-7a269e603c39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041014 Nov 08 17:42:55.307268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 364/749] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:56.118489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7b8d2d0c-8996-42fd-a361-f09c3c0bed14 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e20d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:56.163420 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7b8d2d0c-8996-42fd-a361-f09c3c0bed14 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048917 Nov 08 17:42:56.163966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 386/750] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:56 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:56.318708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-be6e03c7-c6d7-470f-afae-325899349fa5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:56.319573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-be6e03c7-c6d7-470f-afae-325899349fa5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:56.325707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be6e03c7-c6d7-470f-afae-325899349fa5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:56.326145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be6e03c7-c6d7-470f-afae-325899349fa5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:56.326935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be6e03c7-c6d7-470f-afae-325899349fa5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:56.327365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be6e03c7-c6d7-470f-afae-325899349fa5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:56.356572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-be6e03c7-c6d7-470f-afae-325899349fa5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042459 Nov 08 17:42:56.357136 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 365/751] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:57.176469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a502e039-2a5f-44a6-bd47-4d1a696fb4ed tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec55f5e0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:57.221471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a502e039-2a5f-44a6-bd47-4d1a696fb4ed tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049565 Nov 08 17:42:57.222069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 387/752] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:57 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:57.368828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2dcfb52d-825f-4057-8945-be38db378b31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:57.370006 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2dcfb52d-825f-4057-8945-be38db378b31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:57.376351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dcfb52d-825f-4057-8945-be38db378b31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:57.376790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dcfb52d-825f-4057-8945-be38db378b31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:57.377563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dcfb52d-825f-4057-8945-be38db378b31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:57.377994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dcfb52d-825f-4057-8945-be38db378b31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:57.407110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2dcfb52d-825f-4057-8945-be38db378b31 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042091 Nov 08 17:42:57.407675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 366/753] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:58.234707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-923145bd-9f63-439d-a59c-84d940510da6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2d30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:58.279128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-923145bd-9f63-439d-a59c-84d940510da6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048487 Nov 08 17:42:58.279699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 388/754] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:58 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:58.419295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4f05a269-6449-4b58-a825-67b1c2363fcc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:58.420195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4f05a269-6449-4b58-a825-67b1c2363fcc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:58.426371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f05a269-6449-4b58-a825-67b1c2363fcc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:58.426840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f05a269-6449-4b58-a825-67b1c2363fcc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:58.427604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f05a269-6449-4b58-a825-67b1c2363fcc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:58.428034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f05a269-6449-4b58-a825-67b1c2363fcc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:58.456408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4f05a269-6449-4b58-a825-67b1c2363fcc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040812 Nov 08 17:42:58.457688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 367/755] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:42:59.292208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ab097ca2-0322-4a22-b64c-f3ed2bd6162b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec371550>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:59.335872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ab097ca2-0322-4a22-b64c-f3ed2bd6162b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047762 Nov 08 17:42:59.336434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 389/756] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:42:59 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:42:59.468408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-76fe577e-6a78-458c-825b-e3c4cf70bef0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:42:59.469336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-76fe577e-6a78-458c-825b-e3c4cf70bef0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:42:59.476027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-76fe577e-6a78-458c-825b-e3c4cf70bef0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:59.476469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-76fe577e-6a78-458c-825b-e3c4cf70bef0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:59.477238 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-76fe577e-6a78-458c-825b-e3c4cf70bef0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:42:59.477667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-76fe577e-6a78-458c-825b-e3c4cf70bef0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:42:59.506650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-76fe577e-6a78-458c-825b-e3c4cf70bef0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041894 Nov 08 17:42:59.507214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 368/757] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:42:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:00.347579 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-668c3b70-c622-4e74-89bf-4adeb68cae9b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec334af0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:00.396759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-668c3b70-c622-4e74-89bf-4adeb68cae9b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053012 Nov 08 17:43:00.397350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 390/758] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:00 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:00.518004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4365cda8-0267-496b-9d55-a204dbdd4a6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:00.518930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4365cda8-0267-496b-9d55-a204dbdd4a6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:00.525540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4365cda8-0267-496b-9d55-a204dbdd4a6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:00.525978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4365cda8-0267-496b-9d55-a204dbdd4a6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:00.526777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4365cda8-0267-496b-9d55-a204dbdd4a6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:00.527202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4365cda8-0267-496b-9d55-a204dbdd4a6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:00.555684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4365cda8-0267-496b-9d55-a204dbdd4a6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041374 Nov 08 17:43:00.556240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 369/759] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:01.409398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-584aa8fc-5b1f-4983-8bad-7509d19a4d23 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec378670>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:01.456159 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-584aa8fc-5b1f-4983-8bad-7509d19a4d23 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050765 Nov 08 17:43:01.456735 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 391/760] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:01 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:01.567148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9745ab2e-9884-48d3-ba7f-2fa0c5e9995e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:01.568161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9745ab2e-9884-48d3-ba7f-2fa0c5e9995e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:01.574414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9745ab2e-9884-48d3-ba7f-2fa0c5e9995e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:01.574881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9745ab2e-9884-48d3-ba7f-2fa0c5e9995e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:01.575646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9745ab2e-9884-48d3-ba7f-2fa0c5e9995e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:01.576071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9745ab2e-9884-48d3-ba7f-2fa0c5e9995e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:01.605314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9745ab2e-9884-48d3-ba7f-2fa0c5e9995e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041892 Nov 08 17:43:01.605883 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 370/761] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:02.468680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4223e479-8ddc-417d-98dd-36d3207cda2e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec6f40d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:02.515945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4223e479-8ddc-417d-98dd-36d3207cda2e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051214 Nov 08 17:43:02.516517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 392/762] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:02 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:02.616714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-34477ade-637d-478b-b409-0d00c95fb997 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:02.617613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-34477ade-637d-478b-b409-0d00c95fb997 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:02.624149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-34477ade-637d-478b-b409-0d00c95fb997 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:02.624589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-34477ade-637d-478b-b409-0d00c95fb997 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:02.625351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-34477ade-637d-478b-b409-0d00c95fb997 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:02.625779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-34477ade-637d-478b-b409-0d00c95fb997 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:02.655270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-34477ade-637d-478b-b409-0d00c95fb997 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042348 Nov 08 17:43:02.655846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 371/763] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:03.499059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-240d19a4-a443-4b81-b19c-25e237c8437d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:03.500650 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-240d19a4-a443-4b81-b19c-25e237c8437d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:03.506803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-240d19a4-a443-4b81-b19c-25e237c8437d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:03.507246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-240d19a4-a443-4b81-b19c-25e237c8437d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:03.508001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-240d19a4-a443-4b81-b19c-25e237c8437d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:03.508430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-240d19a4-a443-4b81-b19c-25e237c8437d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:03.528601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-44740f78-a553-497f-b866-78e1180f88e4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2fd1f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:03.538049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-240d19a4-a443-4b81-b19c-25e237c8437d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043325 Nov 08 17:43:03.543368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 393/764] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:03 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:03.574274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-44740f78-a553-497f-b866-78e1180f88e4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049157 Nov 08 17:43:03.574956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 372/765] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:03 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:03.605356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-106b714f-2202-406e-a186-897cf3c3da11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:03.605841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-106b714f-2202-406e-a186-897cf3c3da11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:03.611596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-106b714f-2202-406e-a186-897cf3c3da11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:03.612035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-106b714f-2202-406e-a186-897cf3c3da11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:03.612800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-106b714f-2202-406e-a186-897cf3c3da11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:03.613229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-106b714f-2202-406e-a186-897cf3c3da11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:03.636727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-106b714f-2202-406e-a186-897cf3c3da11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:43:03.667704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e3716091-67f9-42b5-b9e9-b60c78f7e680 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:03.668596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e3716091-67f9-42b5-b9e9-b60c78f7e680 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:03.674444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3716091-67f9-42b5-b9e9-b60c78f7e680 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:03.674919 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3716091-67f9-42b5-b9e9-b60c78f7e680 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:03.675688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3716091-67f9-42b5-b9e9-b60c78f7e680 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:03.676118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3716091-67f9-42b5-b9e9-b60c78f7e680 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:03.705365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e3716091-67f9-42b5-b9e9-b60c78f7e680 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041796 Nov 08 17:43:03.705872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 373/766] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:03.974770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-106b714f-2202-406e-a186-897cf3c3da11 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 204 len: 0 microversion: 2.1 time: 0.372625 Nov 08 17:43:03.975286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 394/767] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:43:03 2021] DELETE /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:43:03.983276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d8103707-451b-40af-96f4-f0e8db82ba0e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:03.983881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d8103707-451b-40af-96f4-f0e8db82ba0e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:03.990037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d8103707-451b-40af-96f4-f0e8db82ba0e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:03.990587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d8103707-451b-40af-96f4-f0e8db82ba0e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:03.991385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d8103707-451b-40af-96f4-f0e8db82ba0e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:03.991781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d8103707-451b-40af-96f4-f0e8db82ba0e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:04.122893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d8103707-451b-40af-96f4-f0e8db82ba0e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:04.130981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d8103707-451b-40af-96f4-f0e8db82ba0e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1673 microversion: 2.1 time: 0.151084 Nov 08 17:43:04.131544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 374/768] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:03 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:04.588098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c0489628-b0ee-42d5-906f-8f18d30a265b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec378160>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:04.633760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c0489628-b0ee-42d5-906f-8f18d30a265b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050731 Nov 08 17:43:04.634360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 395/769] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:04 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:04.717089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ff9d7f1c-17b9-4848-ab1f-49217156d0d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:04.717983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ff9d7f1c-17b9-4848-ab1f-49217156d0d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:04.724310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ff9d7f1c-17b9-4848-ab1f-49217156d0d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:04.724748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ff9d7f1c-17b9-4848-ab1f-49217156d0d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:04.725519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ff9d7f1c-17b9-4848-ab1f-49217156d0d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:04.725945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ff9d7f1c-17b9-4848-ab1f-49217156d0d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:04.754343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ff9d7f1c-17b9-4848-ab1f-49217156d0d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040976 Nov 08 17:43:04.755529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 375/770] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:05.147564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cc537933-0e53-4135-97db-4443052baa0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:05.148277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cc537933-0e53-4135-97db-4443052baa0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:05.154850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc537933-0e53-4135-97db-4443052baa0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:05.155296 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc537933-0e53-4135-97db-4443052baa0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:05.156060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc537933-0e53-4135-97db-4443052baa0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:05.156495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc537933-0e53-4135-97db-4443052baa0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:05.289746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cc537933-0e53-4135-97db-4443052baa0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:05.297048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cc537933-0e53-4135-97db-4443052baa0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1673 microversion: 2.1 time: 0.153148 Nov 08 17:43:05.297610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 396/771] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:05 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:05.645852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-94ac2051-4966-4ebb-95d1-4ae390636ed7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd0d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:05.691145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-94ac2051-4966-4ebb-95d1-4ae390636ed7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048812 Nov 08 17:43:05.691714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 376/772] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:05 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:05.766285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-240a4f7f-79d8-4bc4-9aef-9d804ab9d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:05.767266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-240a4f7f-79d8-4bc4-9aef-9d804ab9d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:05.774093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-240a4f7f-79d8-4bc4-9aef-9d804ab9d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:05.775024 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-240a4f7f-79d8-4bc4-9aef-9d804ab9d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:05.775303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-240a4f7f-79d8-4bc4-9aef-9d804ab9d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:05.775742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-240a4f7f-79d8-4bc4-9aef-9d804ab9d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:05.805263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-240a4f7f-79d8-4bc4-9aef-9d804ab9d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042651 Nov 08 17:43:05.805830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 397/773] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:06.314682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-31c0d278-0152-4e01-a9bd-d4f2ad306115 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:06.315303 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-31c0d278-0152-4e01-a9bd-d4f2ad306115 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:06.321193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31c0d278-0152-4e01-a9bd-d4f2ad306115 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:06.321636 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31c0d278-0152-4e01-a9bd-d4f2ad306115 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:06.322400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31c0d278-0152-4e01-a9bd-d4f2ad306115 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:06.322856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31c0d278-0152-4e01-a9bd-d4f2ad306115 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:06.678481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-31c0d278-0152-4e01-a9bd-d4f2ad306115 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:06.685855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-31c0d278-0152-4e01-a9bd-d4f2ad306115 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1673 microversion: 2.1 time: 0.375185 Nov 08 17:43:06.686448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 377/774] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:06 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1673 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:06.703397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e599833e-5727-4151-adef-69ca485d0f2c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec55f700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:06.749832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e599833e-5727-4151-adef-69ca485d0f2c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049898 Nov 08 17:43:06.750389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 398/775] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:06 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:06.816746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d755b3ff-b676-4ad8-a8ed-fc42acd67be6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:06.818259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d755b3ff-b676-4ad8-a8ed-fc42acd67be6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:06.824136 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d755b3ff-b676-4ad8-a8ed-fc42acd67be6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:06.824585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d755b3ff-b676-4ad8-a8ed-fc42acd67be6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:06.825389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d755b3ff-b676-4ad8-a8ed-fc42acd67be6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:06.825825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d755b3ff-b676-4ad8-a8ed-fc42acd67be6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:06.854314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d755b3ff-b676-4ad8-a8ed-fc42acd67be6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041327 Nov 08 17:43:06.854906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 378/776] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:07.703497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0682faa8-3aef-4a61-9a20-c3b97ce50e7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:07.704232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0682faa8-3aef-4a61-9a20-c3b97ce50e7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:07.710278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0682faa8-3aef-4a61-9a20-c3b97ce50e7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:07.710751 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0682faa8-3aef-4a61-9a20-c3b97ce50e7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:07.711518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0682faa8-3aef-4a61-9a20-c3b97ce50e7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:07.711941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0682faa8-3aef-4a61-9a20-c3b97ce50e7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:07.761905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-09ae508b-ca43-47ab-9941-c7242a938688 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37cd30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:07.810978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-09ae508b-ca43-47ab-9941-c7242a938688 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052553 Nov 08 17:43:07.811702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 379/777] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:07 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:07.843076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0682faa8-3aef-4a61-9a20-c3b97ce50e7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:07.851754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0682faa8-3aef-4a61-9a20-c3b97ce50e7e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1673 microversion: 2.1 time: 0.152337 Nov 08 17:43:07.852318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 399/778] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:07 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:07.866172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b2ff1e3c-745e-442f-b677-bd46d408422f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:07.867107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b2ff1e3c-745e-442f-b677-bd46d408422f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:07.873247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e3c-745e-442f-b677-bd46d408422f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:07.873682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e3c-745e-442f-b677-bd46d408422f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:07.874544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e3c-745e-442f-b677-bd46d408422f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:07.875012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2ff1e3c-745e-442f-b677-bd46d408422f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:07.906911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b2ff1e3c-745e-442f-b677-bd46d408422f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045655 Nov 08 17:43:07.907713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 380/779] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:08.823942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d2dde622-61c9-459b-96ba-1d01e2a96bf0 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec55f700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:08.874226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3ecaf9d7-2f94-4c07-9d7b-4d0d01d130b1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:08.874226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3ecaf9d7-2f94-4c07-9d7b-4d0d01d130b1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:08.884489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d2dde622-61c9-459b-96ba-1d01e2a96bf0 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.064320 Nov 08 17:43:08.885269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 400/780] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:08 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:08.890668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3ecaf9d7-2f94-4c07-9d7b-4d0d01d130b1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:08.891110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3ecaf9d7-2f94-4c07-9d7b-4d0d01d130b1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:08.891904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3ecaf9d7-2f94-4c07-9d7b-4d0d01d130b1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:08.892340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3ecaf9d7-2f94-4c07-9d7b-4d0d01d130b1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:08.924918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1f7b8772-c129-4e18-ad85-2d4809b131f6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:08.928114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1f7b8772-c129-4e18-ad85-2d4809b131f6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:08.948612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f7b8772-c129-4e18-ad85-2d4809b131f6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:08.949203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f7b8772-c129-4e18-ad85-2d4809b131f6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:08.950260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f7b8772-c129-4e18-ad85-2d4809b131f6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:08.951341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f7b8772-c129-4e18-ad85-2d4809b131f6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:09.006594 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1f7b8772-c129-4e18-ad85-2d4809b131f6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089787 Nov 08 17:43:09.007958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 401/781] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:09.012643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-02e2c2ba-62e4-4e59-8b22-f749e42a83b3 req-b6a992eb-e5ac-4cc6-9776-63ae4209f718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabb9c79-5e8d-4982-a6eb-4169e2471b27", "name": "network-vif-deleted", "tag": "6c56cad9-14a2-4272-bba1-d1d6fca923bd"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:09.020637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:43:09.020637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:43:09.020998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3ecaf9d7-2f94-4c07-9d7b-4d0d01d130b1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:09.022034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-02e2c2ba-62e4-4e59-8b22-f749e42a83b3 req-b6a992eb-e5ac-4cc6-9776-63ae4209f718 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:09.022754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-02e2c2ba-62e4-4e59-8b22-f749e42a83b3 req-b6a992eb-e5ac-4cc6-9776-63ae4209f718 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:09.031642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3ecaf9d7-2f94-4c07-9d7b-4d0d01d130b1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1605 microversion: 2.1 time: 0.165552 Nov 08 17:43:09.032230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 381/782] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:08 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:09.037203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-02e2c2ba-62e4-4e59-8b22-f749e42a83b3 req-b6a992eb-e5ac-4cc6-9776-63ae4209f718 service nova] Creating event network-vif-deleted:6c56cad9-14a2-4272-bba1-d1d6fca923bd for instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 on hv-cinder-81689 Nov 08 17:43:09.047534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-02e2c2ba-62e4-4e59-8b22-f749e42a83b3 req-b6a992eb-e5ac-4cc6-9776-63ae4209f718 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038193 Nov 08 17:43:09.048606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 402/783] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:43:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:09.103123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8fc29644-4918-4f50-9475-21f8b8382041 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:09.104060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8fc29644-4918-4f50-9475-21f8b8382041 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:09.109945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fc29644-4918-4f50-9475-21f8b8382041 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:09.110562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fc29644-4918-4f50-9475-21f8b8382041 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:09.111647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fc29644-4918-4f50-9475-21f8b8382041 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:09.112306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fc29644-4918-4f50-9475-21f8b8382041 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:09.142426 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-8fc29644-4918-4f50-9475-21f8b8382041 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lazy-loading 'flavor' on Instance uuid 76806517-5f8b-4d47-89f6-66e876baa194 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:43:09.558302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8fc29644-4918-4f50-9475-21f8b8382041 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action" status: 200 len: 32 microversion: 2.1 time: 0.460093 Nov 08 17:43:09.559407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 382/784] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:09 2021] POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action => generated 32 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:09.569809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-41e12ea5-9929-474f-9e63-dfa906bb93e8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:09.570877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-41e12ea5-9929-474f-9e63-dfa906bb93e8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:09.577252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41e12ea5-9929-474f-9e63-dfa906bb93e8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:09.577836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41e12ea5-9929-474f-9e63-dfa906bb93e8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:09.578765 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41e12ea5-9929-474f-9e63-dfa906bb93e8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:09.579290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41e12ea5-9929-474f-9e63-dfa906bb93e8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:09.751060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41e12ea5-9929-474f-9e63-dfa906bb93e8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:09.759950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-41e12ea5-9929-474f-9e63-dfa906bb93e8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.195213 Nov 08 17:43:09.760520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 403/785] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:09.898100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ee463056-1902-4e22-860b-cc608d25162b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd3a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:09.962032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ee463056-1902-4e22-860b-cc608d25162b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.068994 Nov 08 17:43:09.962969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 383/786] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:09 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:10.030711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-76417d3d-21d3-4374-9611-af19c1d23d9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:10.031832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-76417d3d-21d3-4374-9611-af19c1d23d9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:10.039865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76417d3d-21d3-4374-9611-af19c1d23d9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:10.043306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76417d3d-21d3-4374-9611-af19c1d23d9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:10.043306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76417d3d-21d3-4374-9611-af19c1d23d9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:10.043306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76417d3d-21d3-4374-9611-af19c1d23d9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:10.049319 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:10.050048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:10.066181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:10.066667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:10.067681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:10.068115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:10.078870 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-76417d3d-21d3-4374-9611-af19c1d23d9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052672 Nov 08 17:43:10.088115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 404/787] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:10.125135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:10.125581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:10.126201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lazy-loading 'fault' on Instance uuid cabb9c79-5e8d-4982-a6eb-4169e2471b27 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:43:10.180595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:10.190046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6ebae24f-5c83-4fab-9dd3-9717b0134601 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 200 len: 1325 microversion: 2.1 time: 0.144338 Nov 08 17:43:10.192220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 384/788] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:10 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 1325 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:10.777009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a75164ed-2192-49a6-bf36-f380e799255a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:10.777642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a75164ed-2192-49a6-bf36-f380e799255a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:10.783628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a75164ed-2192-49a6-bf36-f380e799255a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:10.784071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a75164ed-2192-49a6-bf36-f380e799255a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:10.784838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a75164ed-2192-49a6-bf36-f380e799255a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:10.785265 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a75164ed-2192-49a6-bf36-f380e799255a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:10.923972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a75164ed-2192-49a6-bf36-f380e799255a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:10.932221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a75164ed-2192-49a6-bf36-f380e799255a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.158850 Nov 08 17:43:10.932776 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 405/789] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:10.973689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-67c56c94-8693-482b-bdb6-0131b21f04ba tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd8b0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:11.021628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-67c56c94-8693-482b-bdb6-0131b21f04ba tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051614 Nov 08 17:43:11.022236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 385/790] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:10 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:11.090918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8e1ea4c7-de29-46ba-9cde-c99147e6fa67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:11.091819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8e1ea4c7-de29-46ba-9cde-c99147e6fa67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:11.098030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8e1ea4c7-de29-46ba-9cde-c99147e6fa67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:11.098580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8e1ea4c7-de29-46ba-9cde-c99147e6fa67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:11.099352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8e1ea4c7-de29-46ba-9cde-c99147e6fa67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:11.099786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8e1ea4c7-de29-46ba-9cde-c99147e6fa67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:11.128494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8e1ea4c7-de29-46ba-9cde-c99147e6fa67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041287 Nov 08 17:43:11.129042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 406/791] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:11.208602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:11.209194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:11.214998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:11.215432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:11.216192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:11.216613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:11.229689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] HTTP exception thrown: Instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 could not be found. Nov 08 17:43:11.230258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Returning 404 to user: Instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:43:11.231080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e2cc5dc1-fbee-40d0-b6f3-e6aa3a4715cf tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 404 len: 111 microversion: 2.1 time: 0.026092 Nov 08 17:43:11.231594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 386/792] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:11 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:43:11.240186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a419c186-a567-4cd1-8316-bb1494d048ed tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '.version_select at 0x7f06ec378dc0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:11.349573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a419c186-a567-4cd1-8316-bb1494d048ed tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-47629218" status: 202 len: 0 microversion: 2.1 time: 0.112146 Nov 08 17:43:11.350949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 407/793] 10.222.0.18 () {58 vars in 1214 bytes} [Mon Nov 8 17:43:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-47629218 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:43:11.950710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a1ed7085-f7df-49a0-b4b0-02fba3b27f91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:11.951315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a1ed7085-f7df-49a0-b4b0-02fba3b27f91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:11.956961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a1ed7085-f7df-49a0-b4b0-02fba3b27f91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:11.957932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a1ed7085-f7df-49a0-b4b0-02fba3b27f91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:11.959515 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a1ed7085-f7df-49a0-b4b0-02fba3b27f91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:11.959515 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a1ed7085-f7df-49a0-b4b0-02fba3b27f91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:12.034077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c5bac317-cfd9-47f1-ab1f-cfc83e8bd948 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec55f9d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:12.088508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c5bac317-cfd9-47f1-ab1f-cfc83e8bd948 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.058594 Nov 08 17:43:12.089084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 408/794] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:12.100870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a1ed7085-f7df-49a0-b4b0-02fba3b27f91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:12.108919 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a1ed7085-f7df-49a0-b4b0-02fba3b27f91 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.161811 Nov 08 17:43:12.109479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 387/795] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:12.142687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ddc40ddf-c852-497d-8e9d-e28d13e8b775 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:12.144107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ddc40ddf-c852-497d-8e9d-e28d13e8b775 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:12.150823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ddc40ddf-c852-497d-8e9d-e28d13e8b775 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:12.151255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ddc40ddf-c852-497d-8e9d-e28d13e8b775 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:12.152195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ddc40ddf-c852-497d-8e9d-e28d13e8b775 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:12.152624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ddc40ddf-c852-497d-8e9d-e28d13e8b775 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:12.180779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ddc40ddf-c852-497d-8e9d-e28d13e8b775 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044425 Nov 08 17:43:12.181415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 409/796] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:12.184865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-291e1213-b82c-429c-a126-236f7d35e989 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'create', calling method: .version_select at 0x7f06ec37cc10>, body: {"keypair": {"name": "tempest-keypair-1832262475"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:12.204638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-291e1213-b82c-429c-a126-236f7d35e989 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for project 8cf7369a158d465290a1686f76514638. Resources: {'key_pairs'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:43:12.209077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-291e1213-b82c-429c-a126-236f7d35e989 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for user 38b562a5b8db48508f2b712487d4ca4a and project 8cf7369a158d465290a1686f76514638. Resources: {'key_pairs'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:43:12.569095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-291e1213-b82c-429c-a126-236f7d35e989 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for project 8cf7369a158d465290a1686f76514638. Resources: {'key_pairs'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:43:12.572726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-291e1213-b82c-429c-a126-236f7d35e989 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for user 38b562a5b8db48508f2b712487d4ca4a and project 8cf7369a158d465290a1686f76514638. Resources: {'key_pairs'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:43:12.585835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-291e1213-b82c-429c-a126-236f7d35e989 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.404723 Nov 08 17:43:12.586435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 388/797] 10.222.0.18 () {60 vars in 1157 bytes} [Mon Nov 8 17:43:12 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:13.101082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f9e1d007-9552-48a7-86c6-70dcf27b6c32 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec335c10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:13.125635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-19eea2b8-f920-4780-9965-8306236d78ac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:13.126241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-19eea2b8-f920-4780-9965-8306236d78ac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:13.132689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-19eea2b8-f920-4780-9965-8306236d78ac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:13.133137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-19eea2b8-f920-4780-9965-8306236d78ac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:13.134033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-19eea2b8-f920-4780-9965-8306236d78ac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:13.134479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-19eea2b8-f920-4780-9965-8306236d78ac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:13.147741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f9e1d007-9552-48a7-86c6-70dcf27b6c32 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050727 Nov 08 17:43:13.154090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 410/798] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:13 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:13.194029 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a042c983-f0a4-4385-b84d-8fa9b7ee17b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:13.195157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a042c983-f0a4-4385-b84d-8fa9b7ee17b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:13.201851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a042c983-f0a4-4385-b84d-8fa9b7ee17b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:13.202333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a042c983-f0a4-4385-b84d-8fa9b7ee17b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:13.203413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a042c983-f0a4-4385-b84d-8fa9b7ee17b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:13.203958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a042c983-f0a4-4385-b84d-8fa9b7ee17b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:13.237257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a042c983-f0a4-4385-b84d-8fa9b7ee17b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049196 Nov 08 17:43:13.237835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 411/799] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:13.273693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-19eea2b8-f920-4780-9965-8306236d78ac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:13.282645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-19eea2b8-f920-4780-9965-8306236d78ac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.161222 Nov 08 17:43:13.283230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 389/800] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:14.159996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-54a01a80-c5f3-4f1f-8114-c8ae3ffed778 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec5e0c10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:14.206844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-54a01a80-c5f3-4f1f-8114-c8ae3ffed778 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050391 Nov 08 17:43:14.208011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 412/801] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:14 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:14.249406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-670d67cb-9842-4cba-b409-918572d72834 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:14.250233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-670d67cb-9842-4cba-b409-918572d72834 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:14.256757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-670d67cb-9842-4cba-b409-918572d72834 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:14.261882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-670d67cb-9842-4cba-b409-918572d72834 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:14.261882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-670d67cb-9842-4cba-b409-918572d72834 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:14.261882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-670d67cb-9842-4cba-b409-918572d72834 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:14.288664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-670d67cb-9842-4cba-b409-918572d72834 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043094 Nov 08 17:43:14.289233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 390/802] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:14.299408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f6561baf-8e60-4722-9fd2-1f6ea3bb5548 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:14.300009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f6561baf-8e60-4722-9fd2-1f6ea3bb5548 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:14.305747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6561baf-8e60-4722-9fd2-1f6ea3bb5548 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:14.306189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6561baf-8e60-4722-9fd2-1f6ea3bb5548 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:14.306982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6561baf-8e60-4722-9fd2-1f6ea3bb5548 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:14.307412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6561baf-8e60-4722-9fd2-1f6ea3bb5548 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:14.439072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f6561baf-8e60-4722-9fd2-1f6ea3bb5548 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:14.448818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f6561baf-8e60-4722-9fd2-1f6ea3bb5548 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.153018 Nov 08 17:43:14.449865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 413/803] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:14.767193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-424828856", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1439e79-2a1d-4b5f-945c-aec344d750cf"}], "security_groups": [{"name": "tempest-securitygroup--35698465"}], "key_name": "tempest-keypair-1832262475", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:14.864118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] validate_networks() for [('e1439e79-2a1d-4b5f-945c-aec344d750cf', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:43:15.219785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0a653234-b76f-47f7-851b-342913447e40 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec5e0c10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:15.222448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:43:15.223419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:43:15.223877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:43:15.224270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:43:15.224670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:43:15.233533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:15.233968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:15.234783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:15.235241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:15.251641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for project 8cf7369a158d465290a1686f76514638. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:43:15.255935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Getting quotas for user 38b562a5b8db48508f2b712487d4ca4a and project 8cf7369a158d465290a1686f76514638. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:43:15.266928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:43:15.267114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0a653234-b76f-47f7-851b-342913447e40 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050833 Nov 08 17:43:15.267684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 414/804] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:15 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:15.269297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:43:15.305289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-800d9b88-1f90-47a2-ac43-6bab646b0b28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:15.305289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-800d9b88-1f90-47a2-ac43-6bab646b0b28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:15.307844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-800d9b88-1f90-47a2-ac43-6bab646b0b28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:15.308283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-800d9b88-1f90-47a2-ac43-6bab646b0b28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:15.309043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-800d9b88-1f90-47a2-ac43-6bab646b0b28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:15.309470 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-800d9b88-1f90-47a2-ac43-6bab646b0b28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:15.337954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-800d9b88-1f90-47a2-ac43-6bab646b0b28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041606 Nov 08 17:43:15.338513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 415/805] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:15.416536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e67872cc-863a-4f3d-9e5b-208a987f7b5e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.653395 Nov 08 17:43:15.417176 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 391/806] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:43:14 2021] POST /compute/v2.1/servers => generated 400 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:43:15.427605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d1b30afd-98a3-4d4d-8ee4-be99aec6f15b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:15.428237 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d1b30afd-98a3-4d4d-8ee4-be99aec6f15b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:15.467185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b605d387-cb3c-4fa5-9cde-640aee04f0b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:15.467790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b605d387-cb3c-4fa5-9cde-640aee04f0b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:15.473721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b605d387-cb3c-4fa5-9cde-640aee04f0b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:15.474186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b605d387-cb3c-4fa5-9cde-640aee04f0b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:15.474952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b605d387-cb3c-4fa5-9cde-640aee04f0b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:15.475386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b605d387-cb3c-4fa5-9cde-640aee04f0b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:15.481411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d1b30afd-98a3-4d4d-8ee4-be99aec6f15b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:15.487963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d1b30afd-98a3-4d4d-8ee4-be99aec6f15b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1237 microversion: 2.1 time: 0.064734 Nov 08 17:43:15.494186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 416/807] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:15 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:15.627137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b605d387-cb3c-4fa5-9cde-640aee04f0b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:15.635639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b605d387-cb3c-4fa5-9cde-640aee04f0b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.172034 Nov 08 17:43:15.636227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 392/808] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:16.279550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d2cef56d-6239-4c8e-b995-bcbebd06e4c5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2c10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:16.326079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d2cef56d-6239-4c8e-b995-bcbebd06e4c5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050212 Nov 08 17:43:16.326835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 417/809] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:16 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:16.349565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f7e17ca8-ad44-4e88-a6b4-de7263d5e785 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:16.350546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f7e17ca8-ad44-4e88-a6b4-de7263d5e785 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:16.356986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f7e17ca8-ad44-4e88-a6b4-de7263d5e785 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:16.357809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f7e17ca8-ad44-4e88-a6b4-de7263d5e785 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:16.358261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f7e17ca8-ad44-4e88-a6b4-de7263d5e785 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:16.358742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f7e17ca8-ad44-4e88-a6b4-de7263d5e785 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:16.390038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f7e17ca8-ad44-4e88-a6b4-de7263d5e785 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044791 Nov 08 17:43:16.390633 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 393/810] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:16.507152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b1f40098-fb8e-490e-ba11-e0a5280ca5b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:16.507758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b1f40098-fb8e-490e-ba11-e0a5280ca5b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:16.514236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1f40098-fb8e-490e-ba11-e0a5280ca5b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:16.514717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1f40098-fb8e-490e-ba11-e0a5280ca5b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:16.515489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1f40098-fb8e-490e-ba11-e0a5280ca5b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:16.515921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1f40098-fb8e-490e-ba11-e0a5280ca5b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:16.575574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b1f40098-fb8e-490e-ba11-e0a5280ca5b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:16.583391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b1f40098-fb8e-490e-ba11-e0a5280ca5b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1241 microversion: 2.1 time: 0.080815 Nov 08 17:43:16.584008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 418/811] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:16 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:16.652727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f85ddad6-1cb3-40b0-ad68-485e102ea336 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:16.653347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f85ddad6-1cb3-40b0-ad68-485e102ea336 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:16.659175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f85ddad6-1cb3-40b0-ad68-485e102ea336 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:16.659614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f85ddad6-1cb3-40b0-ad68-485e102ea336 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:16.660869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f85ddad6-1cb3-40b0-ad68-485e102ea336 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:16.661298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f85ddad6-1cb3-40b0-ad68-485e102ea336 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:16.788583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f85ddad6-1cb3-40b0-ad68-485e102ea336 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:16.796486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f85ddad6-1cb3-40b0-ad68-485e102ea336 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.147361 Nov 08 17:43:16.797082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 394/812] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:17.339204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b3479320-2557-4e25-8c79-2840855f3521 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2d30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:17.388461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b3479320-2557-4e25-8c79-2840855f3521 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052894 Nov 08 17:43:17.390473 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 419/813] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:17 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:17.401827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b926aa48-1a9f-44fd-acac-35c3b4f9f628 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:17.402731 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b926aa48-1a9f-44fd-acac-35c3b4f9f628 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:17.408867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b926aa48-1a9f-44fd-acac-35c3b4f9f628 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:17.409305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b926aa48-1a9f-44fd-acac-35c3b4f9f628 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:17.410069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b926aa48-1a9f-44fd-acac-35c3b4f9f628 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:17.410549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b926aa48-1a9f-44fd-acac-35c3b4f9f628 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:17.439367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b926aa48-1a9f-44fd-acac-35c3b4f9f628 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041198 Nov 08 17:43:17.439924 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 395/814] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:17.601489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b95d59cf-e8c0-4cc2-b207-0fa723a92926 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:17.601994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b95d59cf-e8c0-4cc2-b207-0fa723a92926 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:17.608172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b95d59cf-e8c0-4cc2-b207-0fa723a92926 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:17.608617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b95d59cf-e8c0-4cc2-b207-0fa723a92926 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:17.609388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b95d59cf-e8c0-4cc2-b207-0fa723a92926 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:17.609819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b95d59cf-e8c0-4cc2-b207-0fa723a92926 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:17.681414 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b95d59cf-e8c0-4cc2-b207-0fa723a92926 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:17.688639 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b95d59cf-e8c0-4cc2-b207-0fa723a92926 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1307 microversion: 2.1 time: 0.092350 Nov 08 17:43:17.689213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 420/815] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:17 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:17.812813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-484d4f46-e465-43e3-8d92-fdbf2e61d63c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:17.813513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-484d4f46-e465-43e3-8d92-fdbf2e61d63c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:17.820369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-484d4f46-e465-43e3-8d92-fdbf2e61d63c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:17.820811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-484d4f46-e465-43e3-8d92-fdbf2e61d63c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:17.821575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-484d4f46-e465-43e3-8d92-fdbf2e61d63c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:17.822002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-484d4f46-e465-43e3-8d92-fdbf2e61d63c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:18.061135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-484d4f46-e465-43e3-8d92-fdbf2e61d63c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:18.069767 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-484d4f46-e465-43e3-8d92-fdbf2e61d63c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.260539 Nov 08 17:43:18.070418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 396/816] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:18.401092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c9ea7f45-e4b2-40ce-b5a1-06c2284b50be tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d21f0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:18.450910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c9ea7f45-e4b2-40ce-b5a1-06c2284b50be tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053483 Nov 08 17:43:18.451481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 421/817] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:18 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:18.452554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8d25dd40-bde5-415d-8c8b-315f11b84cf0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:18.453640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8d25dd40-bde5-415d-8c8b-315f11b84cf0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:18.460897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d25dd40-bde5-415d-8c8b-315f11b84cf0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:18.462991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d25dd40-bde5-415d-8c8b-315f11b84cf0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:18.463878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d25dd40-bde5-415d-8c8b-315f11b84cf0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:18.464318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d25dd40-bde5-415d-8c8b-315f11b84cf0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:18.499956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8d25dd40-bde5-415d-8c8b-315f11b84cf0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051275 Nov 08 17:43:18.500531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 397/818] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:18.706135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7fa055c1-69ab-4a7e-a50a-522d1f5282c5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:18.706676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7fa055c1-69ab-4a7e-a50a-522d1f5282c5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:18.712951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7fa055c1-69ab-4a7e-a50a-522d1f5282c5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:18.713439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7fa055c1-69ab-4a7e-a50a-522d1f5282c5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:18.714207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7fa055c1-69ab-4a7e-a50a-522d1f5282c5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:18.714657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7fa055c1-69ab-4a7e-a50a-522d1f5282c5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:18.874640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7fa055c1-69ab-4a7e-a50a-522d1f5282c5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:18.882419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7fa055c1-69ab-4a7e-a50a-522d1f5282c5 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1361 microversion: 2.1 time: 0.179952 Nov 08 17:43:18.883005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 422/819] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:18 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:19.096321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4373576b-16f4-4db9-9ead-cde313394675 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:19.096939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4373576b-16f4-4db9-9ead-cde313394675 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:19.103372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4373576b-16f4-4db9-9ead-cde313394675 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:19.103825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4373576b-16f4-4db9-9ead-cde313394675 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:19.104601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4373576b-16f4-4db9-9ead-cde313394675 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:19.105038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4373576b-16f4-4db9-9ead-cde313394675 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:19.223446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-d8ac9233-166c-4a66-a03d-611bc719b11d req-045bf297-9943-47a5-8f8f-7acd1426bf7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a296b-b0ac-4115-a9a2-f536ff671fea", "tag": "4ad212cb-fb00-4b9c-a3e0-700699dcc819"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:19.225578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:43:19.225578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:43:19.243649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-d8ac9233-166c-4a66-a03d-611bc719b11d req-045bf297-9943-47a5-8f8f-7acd1426bf7b service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:19.250299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-d8ac9233-166c-4a66-a03d-611bc719b11d req-045bf297-9943-47a5-8f8f-7acd1426bf7b service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:19.271852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-d8ac9233-166c-4a66-a03d-611bc719b11d req-045bf297-9943-47a5-8f8f-7acd1426bf7b service nova] Creating event network-changed:4ad212cb-fb00-4b9c-a3e0-700699dcc819 for instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea on hv-cinder-81689 Nov 08 17:43:19.288770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-d8ac9233-166c-4a66-a03d-611bc719b11d req-045bf297-9943-47a5-8f8f-7acd1426bf7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069930 Nov 08 17:43:19.289993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 423/820] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:43:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:19.321626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4373576b-16f4-4db9-9ead-cde313394675 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:19.329930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4373576b-16f4-4db9-9ead-cde313394675 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.237227 Nov 08 17:43:19.333149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 398/821] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:19.463271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-36ed2c5d-2652-4097-b015-adef9225aa10 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec6fd5e0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:19.511433 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ca8850c7-1f24-46ac-9825-7f924103c9a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:19.512369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ca8850c7-1f24-46ac-9825-7f924103c9a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:19.518340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca8850c7-1f24-46ac-9825-7f924103c9a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:19.519026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca8850c7-1f24-46ac-9825-7f924103c9a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:19.520252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca8850c7-1f24-46ac-9825-7f924103c9a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:19.521156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ca8850c7-1f24-46ac-9825-7f924103c9a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:19.522733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-36ed2c5d-2652-4097-b015-adef9225aa10 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.063269 Nov 08 17:43:19.523379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 424/822] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:19 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:19.551808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ca8850c7-1f24-46ac-9825-7f924103c9a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043389 Nov 08 17:43:19.552380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 399/823] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:19.899820 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0c961836-7d0e-44fa-963b-0f815d432538 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:19.900546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0c961836-7d0e-44fa-963b-0f815d432538 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:19.906551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0c961836-7d0e-44fa-963b-0f815d432538 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:19.907006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0c961836-7d0e-44fa-963b-0f815d432538 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:19.907786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0c961836-7d0e-44fa-963b-0f815d432538 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:19.908232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0c961836-7d0e-44fa-963b-0f815d432538 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:20.076373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0c961836-7d0e-44fa-963b-0f815d432538 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:20.084494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0c961836-7d0e-44fa-963b-0f815d432538 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1361 microversion: 2.1 time: 0.188351 Nov 08 17:43:20.085047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 425/824] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:19 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:20.348295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7078201b-7690-4d27-a16c-9d5d8f0cb532 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:20.348890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7078201b-7690-4d27-a16c-9d5d8f0cb532 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:20.354580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7078201b-7690-4d27-a16c-9d5d8f0cb532 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:20.355025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7078201b-7690-4d27-a16c-9d5d8f0cb532 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:20.355783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7078201b-7690-4d27-a16c-9d5d8f0cb532 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:20.356206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7078201b-7690-4d27-a16c-9d5d8f0cb532 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:20.481511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7078201b-7690-4d27-a16c-9d5d8f0cb532 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:20.490388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7078201b-7690-4d27-a16c-9d5d8f0cb532 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.146294 Nov 08 17:43:20.491006 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 400/825] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:20.534841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e80ec3f9-ead9-4eaf-8396-bc3edfc224e5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec287820>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:20.563264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5aba476d-b68d-4496-a851-5ff890f9864e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:20.564241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5aba476d-b68d-4496-a851-5ff890f9864e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:20.570810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5aba476d-b68d-4496-a851-5ff890f9864e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:20.571257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5aba476d-b68d-4496-a851-5ff890f9864e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:20.572035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5aba476d-b68d-4496-a851-5ff890f9864e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:20.572465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5aba476d-b68d-4496-a851-5ff890f9864e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:20.581263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e80ec3f9-ead9-4eaf-8396-bc3edfc224e5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049956 Nov 08 17:43:20.581906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 426/826] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:20 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:20.601632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5aba476d-b68d-4496-a851-5ff890f9864e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042160 Nov 08 17:43:20.602189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 401/827] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:21.100901 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b6aef728-1fca-46c0-86d7-21b84f2276da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:21.101507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b6aef728-1fca-46c0-86d7-21b84f2276da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:21.107440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6aef728-1fca-46c0-86d7-21b84f2276da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:21.107876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6aef728-1fca-46c0-86d7-21b84f2276da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:21.108636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6aef728-1fca-46c0-86d7-21b84f2276da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:21.109065 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6aef728-1fca-46c0-86d7-21b84f2276da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:21.244766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b6aef728-1fca-46c0-86d7-21b84f2276da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:21.251875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b6aef728-1fca-46c0-86d7-21b84f2276da tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1361 microversion: 2.1 time: 0.154688 Nov 08 17:43:21.252425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 427/828] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:21 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:21.507764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a110417e-4366-493f-a8e2-204bc6cd13b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:21.526999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a110417e-4366-493f-a8e2-204bc6cd13b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:21.526999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a110417e-4366-493f-a8e2-204bc6cd13b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:21.526999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a110417e-4366-493f-a8e2-204bc6cd13b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:21.526999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a110417e-4366-493f-a8e2-204bc6cd13b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:21.527415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a110417e-4366-493f-a8e2-204bc6cd13b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:21.594487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0a98a611-2664-415c-9268-3607b2b76352 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec56d3a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:21.642600 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0a98a611-2664-415c-9268-3607b2b76352 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052774 Nov 08 17:43:21.643169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 428/829] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:21 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:21.648403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-279ec3a8-04cf-4d9f-b1e9-93d5c476ff3d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:21.649302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-279ec3a8-04cf-4d9f-b1e9-93d5c476ff3d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:21.655751 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-279ec3a8-04cf-4d9f-b1e9-93d5c476ff3d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:21.656193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-279ec3a8-04cf-4d9f-b1e9-93d5c476ff3d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:21.656980 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-279ec3a8-04cf-4d9f-b1e9-93d5c476ff3d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:21.657387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a110417e-4366-493f-a8e2-204bc6cd13b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:21.657892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-279ec3a8-04cf-4d9f-b1e9-93d5c476ff3d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:21.669028 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a110417e-4366-493f-a8e2-204bc6cd13b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.165310 Nov 08 17:43:21.669639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 402/830] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:21.695319 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-279ec3a8-04cf-4d9f-b1e9-93d5c476ff3d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050953 Nov 08 17:43:21.701396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 429/831] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:22.269007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-df040227-4407-45e6-ba38-967ba01892e2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:22.270568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-df040227-4407-45e6-ba38-967ba01892e2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:22.276419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df040227-4407-45e6-ba38-967ba01892e2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:22.276863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df040227-4407-45e6-ba38-967ba01892e2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:22.277630 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df040227-4407-45e6-ba38-967ba01892e2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:22.278066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df040227-4407-45e6-ba38-967ba01892e2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:22.643660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df040227-4407-45e6-ba38-967ba01892e2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:22.652050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-df040227-4407-45e6-ba38-967ba01892e2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1361 microversion: 2.1 time: 0.386829 Nov 08 17:43:22.652609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 403/832] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:22 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:22.655344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-61fb1e05-beca-4f33-aa45-c1d81999f2fd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3359d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:22.685957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8e397b74-65cb-476e-b38c-846fa42443c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:22.686601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8e397b74-65cb-476e-b38c-846fa42443c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:22.693147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8e397b74-65cb-476e-b38c-846fa42443c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:22.693593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8e397b74-65cb-476e-b38c-846fa42443c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:22.694373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8e397b74-65cb-476e-b38c-846fa42443c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:22.694875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8e397b74-65cb-476e-b38c-846fa42443c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:22.703754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-61fb1e05-beca-4f33-aa45-c1d81999f2fd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051863 Nov 08 17:43:22.704461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 430/833] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:22 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:22.716168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ecc676f2-eefa-4112-bd16-47b6236b4c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:22.717098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ecc676f2-eefa-4112-bd16-47b6236b4c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:22.723952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecc676f2-eefa-4112-bd16-47b6236b4c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:22.724550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecc676f2-eefa-4112-bd16-47b6236b4c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:22.725341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecc676f2-eefa-4112-bd16-47b6236b4c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:22.725774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecc676f2-eefa-4112-bd16-47b6236b4c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:22.755087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ecc676f2-eefa-4112-bd16-47b6236b4c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042355 Nov 08 17:43:22.755657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 431/834] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:22.824637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8e397b74-65cb-476e-b38c-846fa42443c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:22.833186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8e397b74-65cb-476e-b38c-846fa42443c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.150618 Nov 08 17:43:22.833746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 404/835] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:23.655366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-e1577360-b027-4e2f-b6bd-06b89d8ce5bb req-604db66c-5242-41ff-b4e7-0619be145c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a296b-b0ac-4115-a9a2-f536ff671fea", "name": "network-vif-plugged", "status": "completed", "tag": "4ad212cb-fb00-4b9c-a3e0-700699dcc819"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:23.656880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:43:23.656880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:43:23.664924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-e1577360-b027-4e2f-b6bd-06b89d8ce5bb req-604db66c-5242-41ff-b4e7-0619be145c3e service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:23.669611 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-e1577360-b027-4e2f-b6bd-06b89d8ce5bb req-604db66c-5242-41ff-b4e7-0619be145c3e service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:23.669765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9116a94b-63d0-4c9c-adcc-d7dd590eace1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:23.669765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9116a94b-63d0-4c9c-adcc-d7dd590eace1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:23.676669 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9116a94b-63d0-4c9c-adcc-d7dd590eace1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:23.677058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-e1577360-b027-4e2f-b6bd-06b89d8ce5bb req-604db66c-5242-41ff-b4e7-0619be145c3e service nova] Creating event network-vif-plugged:4ad212cb-fb00-4b9c-a3e0-700699dcc819 for instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea on hv-cinder-81689 Nov 08 17:43:23.677182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9116a94b-63d0-4c9c-adcc-d7dd590eace1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:23.677885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9116a94b-63d0-4c9c-adcc-d7dd590eace1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:23.678319 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9116a94b-63d0-4c9c-adcc-d7dd590eace1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:23.681865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-e1577360-b027-4e2f-b6bd-06b89d8ce5bb req-604db66c-5242-41ff-b4e7-0619be145c3e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030185 Nov 08 17:43:23.682483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 432/836] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:43:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:23.717290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-08811319-8158-4d5c-a471-68c19068bf8d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec6f4ee0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:23.769187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-08811319-8158-4d5c-a471-68c19068bf8d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.055698 Nov 08 17:43:23.774640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 433/837] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:23 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:23.775240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b93d26d0-9c6b-49f3-9a59-ce54da91aba2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:23.776278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b93d26d0-9c6b-49f3-9a59-ce54da91aba2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:23.790791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b93d26d0-9c6b-49f3-9a59-ce54da91aba2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:23.791504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b93d26d0-9c6b-49f3-9a59-ce54da91aba2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:23.792327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b93d26d0-9c6b-49f3-9a59-ce54da91aba2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:23.792760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b93d26d0-9c6b-49f3-9a59-ce54da91aba2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:23.825082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b93d26d0-9c6b-49f3-9a59-ce54da91aba2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053648 Nov 08 17:43:23.825829 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 434/838] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:23.828880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9116a94b-63d0-4c9c-adcc-d7dd590eace1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:23.837497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9116a94b-63d0-4c9c-adcc-d7dd590eace1 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1361 microversion: 2.1 time: 0.172251 Nov 08 17:43:23.838353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 405/839] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:23 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:23.850066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-413a5214-15e6-4c4f-8ad8-cadacbf1bd84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:23.850684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-413a5214-15e6-4c4f-8ad8-cadacbf1bd84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:23.856493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-413a5214-15e6-4c4f-8ad8-cadacbf1bd84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:23.856930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-413a5214-15e6-4c4f-8ad8-cadacbf1bd84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:23.857690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-413a5214-15e6-4c4f-8ad8-cadacbf1bd84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:23.858117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-413a5214-15e6-4c4f-8ad8-cadacbf1bd84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:24.012375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-413a5214-15e6-4c4f-8ad8-cadacbf1bd84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:24.020918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-413a5214-15e6-4c4f-8ad8-cadacbf1bd84 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.175168 Nov 08 17:43:24.021490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 435/840] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:24.781051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dca73284-f91a-42d0-8e5a-09c8732cd555 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec31cd30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:24.827168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dca73284-f91a-42d0-8e5a-09c8732cd555 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049763 Nov 08 17:43:24.827848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 406/841] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:24 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:24.837369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9083841c-c766-41c5-afa8-be0bf9372904 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:24.838327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9083841c-c766-41c5-afa8-be0bf9372904 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:24.844607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9083841c-c766-41c5-afa8-be0bf9372904 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:24.845051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9083841c-c766-41c5-afa8-be0bf9372904 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:24.845819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9083841c-c766-41c5-afa8-be0bf9372904 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:24.846251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9083841c-c766-41c5-afa8-be0bf9372904 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:24.854034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-098fe328-8c3d-4bab-bf42-c10c20adf5d2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:24.854693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-098fe328-8c3d-4bab-bf42-c10c20adf5d2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:24.860587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-098fe328-8c3d-4bab-bf42-c10c20adf5d2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:24.861032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-098fe328-8c3d-4bab-bf42-c10c20adf5d2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:24.861796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-098fe328-8c3d-4bab-bf42-c10c20adf5d2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:24.862225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-098fe328-8c3d-4bab-bf42-c10c20adf5d2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:24.877510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9083841c-c766-41c5-afa8-be0bf9372904 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043928 Nov 08 17:43:24.878287 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 436/842] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:24.992177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-098fe328-8c3d-4bab-bf42-c10c20adf5d2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:24.999320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-098fe328-8c3d-4bab-bf42-c10c20adf5d2 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1361 microversion: 2.1 time: 0.148800 Nov 08 17:43:25.000090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 407/843] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:24 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:25.037576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f00b83c7-e6a7-4319-a569-15dd087e30cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:25.038100 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f00b83c7-e6a7-4319-a569-15dd087e30cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:25.043886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f00b83c7-e6a7-4319-a569-15dd087e30cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:25.044326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f00b83c7-e6a7-4319-a569-15dd087e30cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:25.045091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f00b83c7-e6a7-4319-a569-15dd087e30cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:25.045522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f00b83c7-e6a7-4319-a569-15dd087e30cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:25.174797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f00b83c7-e6a7-4319-a569-15dd087e30cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:25.183622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f00b83c7-e6a7-4319-a569-15dd087e30cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.150373 Nov 08 17:43:25.184197 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 437/844] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:25.840109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1a9e3278-cd61-4284-b1d0-2d8d8bccb218 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2a19d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:25.885272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1a9e3278-cd61-4284-b1d0-2d8d8bccb218 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048808 Nov 08 17:43:25.889131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6a34d837-0951-4c8d-9dbd-23589d9e1e84 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:25.889677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 408/845] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:25 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:25.890034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6a34d837-0951-4c8d-9dbd-23589d9e1e84 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:25.896845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a34d837-0951-4c8d-9dbd-23589d9e1e84 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:25.897288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a34d837-0951-4c8d-9dbd-23589d9e1e84 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:25.898087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a34d837-0951-4c8d-9dbd-23589d9e1e84 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:25.898622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a34d837-0951-4c8d-9dbd-23589d9e1e84 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:25.927814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6a34d837-0951-4c8d-9dbd-23589d9e1e84 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042471 Nov 08 17:43:25.928371 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 438/846] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:26.016085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a56b29e5-7b48-42d1-b88d-43deace7a892 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:26.016680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a56b29e5-7b48-42d1-b88d-43deace7a892 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:26.022614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a56b29e5-7b48-42d1-b88d-43deace7a892 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:26.023163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a56b29e5-7b48-42d1-b88d-43deace7a892 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:26.023935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a56b29e5-7b48-42d1-b88d-43deace7a892 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:26.024357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a56b29e5-7b48-42d1-b88d-43deace7a892 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:26.152128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a56b29e5-7b48-42d1-b88d-43deace7a892 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:26.159254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a56b29e5-7b48-42d1-b88d-43deace7a892 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1547 microversion: 2.1 time: 0.146765 Nov 08 17:43:26.160164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 409/847] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:26 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:26.175271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-aeb0f9d4-030b-4bd5-87c1-5a6e89a29b63 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:26.176269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-aeb0f9d4-030b-4bd5-87c1-5a6e89a29b63 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:26.182201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aeb0f9d4-030b-4bd5-87c1-5a6e89a29b63 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:26.182693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aeb0f9d4-030b-4bd5-87c1-5a6e89a29b63 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:26.183469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aeb0f9d4-030b-4bd5-87c1-5a6e89a29b63 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:26.183904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aeb0f9d4-030b-4bd5-87c1-5a6e89a29b63 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:26.200282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1247d173-801f-4e30-8e14-2306a9a91bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:26.200893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1247d173-801f-4e30-8e14-2306a9a91bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:26.206712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1247d173-801f-4e30-8e14-2306a9a91bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:26.207415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1247d173-801f-4e30-8e14-2306a9a91bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:26.208189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1247d173-801f-4e30-8e14-2306a9a91bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:26.208623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1247d173-801f-4e30-8e14-2306a9a91bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:26.288617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-aeb0f9d4-030b-4bd5-87c1-5a6e89a29b63 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116627 Nov 08 17:43:26.289496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 439/848] 10.222.0.18 () {58 vars in 1274 bytes} [Mon Nov 8 17:43:26 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:26.353018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1247d173-801f-4e30-8e14-2306a9a91bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:26.365172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1247d173-801f-4e30-8e14-2306a9a91bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.164332 Nov 08 17:43:26.365172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 410/849] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:26.898112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2d9f4fe2-7e90-4366-a7c6-0ffa64c39b05 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec287dc0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:26.949882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7c125900-bd52-40d0-b844-799b52d7e349 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:26.951373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7c125900-bd52-40d0-b844-799b52d7e349 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:26.960830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7c125900-bd52-40d0-b844-799b52d7e349 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:26.966419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2d9f4fe2-7e90-4366-a7c6-0ffa64c39b05 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.067380 Nov 08 17:43:26.966818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7c125900-bd52-40d0-b844-799b52d7e349 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:26.966906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 440/850] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:26 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:26.966980 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7c125900-bd52-40d0-b844-799b52d7e349 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:26.967852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7c125900-bd52-40d0-b844-799b52d7e349 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:26.998539 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7c125900-bd52-40d0-b844-799b52d7e349 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052650 Nov 08 17:43:26.999308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 411/851] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:27.380659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-be58090d-e3bd-464c-915a-a8c34882fac0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:27.381261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-be58090d-e3bd-464c-915a-a8c34882fac0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:27.387329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be58090d-e3bd-464c-915a-a8c34882fac0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:27.387771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be58090d-e3bd-464c-915a-a8c34882fac0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:27.388534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be58090d-e3bd-464c-915a-a8c34882fac0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:27.388961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be58090d-e3bd-464c-915a-a8c34882fac0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:27.496217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4e269615-ee2e-4aba-bb64-a4c154ce3cab tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:27.497389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4e269615-ee2e-4aba-bb64-a4c154ce3cab tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:27.504352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4e269615-ee2e-4aba-bb64-a4c154ce3cab tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:27.505041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4e269615-ee2e-4aba-bb64-a4c154ce3cab tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:27.505820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4e269615-ee2e-4aba-bb64-a4c154ce3cab tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:27.506249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4e269615-ee2e-4aba-bb64-a4c154ce3cab tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:27.533784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-be58090d-e3bd-464c-915a-a8c34882fac0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:27.544115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-be58090d-e3bd-464c-915a-a8c34882fac0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.167263 Nov 08 17:43:27.544694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 441/852] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:27.557974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-f52daa98-636d-4b1f-8371-5ad4353abc0c req-2696fcf0-6586-43d8-900b-d65f1237e183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a296b-b0ac-4115-a9a2-f536ff671fea", "tag": "4ad212cb-fb00-4b9c-a3e0-700699dcc819"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:27.559409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:43:27.559409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:43:27.565952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-f52daa98-636d-4b1f-8371-5ad4353abc0c req-2696fcf0-6586-43d8-900b-d65f1237e183 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:27.566486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-f52daa98-636d-4b1f-8371-5ad4353abc0c req-2696fcf0-6586-43d8-900b-d65f1237e183 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:27.570916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4e269615-ee2e-4aba-bb64-a4c154ce3cab tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.078430 Nov 08 17:43:27.571589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 412/853] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:27 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:27.577227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-f52daa98-636d-4b1f-8371-5ad4353abc0c req-2696fcf0-6586-43d8-900b-d65f1237e183 service nova] Creating event network-changed:4ad212cb-fb00-4b9c-a3e0-700699dcc819 for instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea on hv-cinder-81689 Nov 08 17:43:27.582401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-f52daa98-636d-4b1f-8371-5ad4353abc0c req-2696fcf0-6586-43d8-900b-d65f1237e183 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027261 Nov 08 17:43:27.583173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 442/854] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:43:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:27.981986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-67b5dc4a-d8dc-4782-a3c2-77800b1b1678 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec353a60>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:28.010407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c255ecba-2662-49e6-8ccf-ea4b6cc6ff7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:28.011416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c255ecba-2662-49e6-8ccf-ea4b6cc6ff7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:28.020281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c255ecba-2662-49e6-8ccf-ea4b6cc6ff7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.021684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c255ecba-2662-49e6-8ccf-ea4b6cc6ff7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.022031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c255ecba-2662-49e6-8ccf-ea4b6cc6ff7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.022739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c255ecba-2662-49e6-8ccf-ea4b6cc6ff7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.058165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c255ecba-2662-49e6-8ccf-ea4b6cc6ff7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051859 Nov 08 17:43:28.059412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 443/855] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:28.059893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-67b5dc4a-d8dc-4782-a3c2-77800b1b1678 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.090315 Nov 08 17:43:28.060596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 413/856] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:27 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:28.560797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-25a4c5d3-d77e-43e9-a45a-c021600fa7bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:28.561401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-25a4c5d3-d77e-43e9-a45a-c021600fa7bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:28.567864 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-25a4c5d3-d77e-43e9-a45a-c021600fa7bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.568312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-25a4c5d3-d77e-43e9-a45a-c021600fa7bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.569153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-25a4c5d3-d77e-43e9-a45a-c021600fa7bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.569593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-25a4c5d3-d77e-43e9-a45a-c021600fa7bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.581167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-969f608a-f269-4069-bbf8-f0581d9103a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:28.583045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-969f608a-f269-4069-bbf8-f0581d9103a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:28.590336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-969f608a-f269-4069-bbf8-f0581d9103a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.591044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-969f608a-f269-4069-bbf8-f0581d9103a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.591835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-969f608a-f269-4069-bbf8-f0581d9103a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.592263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-969f608a-f269-4069-bbf8-f0581d9103a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.656679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-969f608a-f269-4069-bbf8-f0581d9103a0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.078768 Nov 08 17:43:28.657234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 414/857] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:28 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 17:43:28.712080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-25a4c5d3-d77e-43e9-a45a-c021600fa7bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:28.720611 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-25a4c5d3-d77e-43e9-a45a-c021600fa7bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1549 microversion: 2.1 time: 0.163422 Nov 08 17:43:28.721496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 444/858] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:28.739382 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:28.740007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:28.747070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.747516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.748288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.748728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.824869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] HTTP exception thrown: Cannot 'detach_volume' instance 76806517-5f8b-4d47-89f6-66e876baa194 while it is in vm_state rescued Nov 08 17:43:28.825462 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Returning 409 to user: Cannot 'detach_volume' instance 76806517-5f8b-4d47-89f6-66e876baa194 while it is in vm_state rescued {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:43:28.826307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-91fc3476-7301-450b-a402-06f9cb489371 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "DELETE /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments/f54de683-58ee-4fdd-b244-ddf98021e64d" status: 409 len: 152 microversion: 2.1 time: 0.091639 Nov 08 17:43:28.826902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 415/859] 10.222.0.18 () {58 vars in 1415 bytes} [Mon Nov 8 17:43:28 2021] DELETE /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments/f54de683-58ee-4fdd-b244-ddf98021e64d => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 08 17:43:28.835991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7e68bb81-2d8b-42af-b2a4-7e1669c50b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:28.836527 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7e68bb81-2d8b-42af-b2a4-7e1669c50b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:28.842279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e68bb81-2d8b-42af-b2a4-7e1669c50b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.842762 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e68bb81-2d8b-42af-b2a4-7e1669c50b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:28.843531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e68bb81-2d8b-42af-b2a4-7e1669c50b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:28.843963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e68bb81-2d8b-42af-b2a4-7e1669c50b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:29.071067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a14bb41b-8359-4691-9f6c-8583a7fe5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:29.071972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a14bb41b-8359-4691-9f6c-8583a7fe5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:29.079308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a14bb41b-8359-4691-9f6c-8583a7fe5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:29.079882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a14bb41b-8359-4691-9f6c-8583a7fe5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:29.080667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a14bb41b-8359-4691-9f6c-8583a7fe5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:29.081103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a14bb41b-8359-4691-9f6c-8583a7fe5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:29.081305 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7e68bb81-2d8b-42af-b2a4-7e1669c50b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action" status: 202 len: 0 microversion: 2.1 time: 0.249769 Nov 08 17:43:29.083415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 445/860] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:28 2021] POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:43:29.088794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-800eab4c-3216-4da7-b5fd-5ac0d13932ef tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3734c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:29.112281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a14bb41b-8359-4691-9f6c-8583a7fe5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045984 Nov 08 17:43:29.117578 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 416/861] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:29.117578 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f3c69e1b-5909-49c0-b851-9077e82e7747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:29.118561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f3c69e1b-5909-49c0-b851-9077e82e7747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:29.123953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f3c69e1b-5909-49c0-b851-9077e82e7747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:29.124387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f3c69e1b-5909-49c0-b851-9077e82e7747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:29.125150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f3c69e1b-5909-49c0-b851-9077e82e7747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:29.125621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f3c69e1b-5909-49c0-b851-9077e82e7747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:29.135588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-800eab4c-3216-4da7-b5fd-5ac0d13932ef tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052248 Nov 08 17:43:29.136164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 446/862] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:29 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:29.288765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f3c69e1b-5909-49c0-b851-9077e82e7747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:29.296526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f3c69e1b-5909-49c0-b851-9077e82e7747 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1557 microversion: 2.1 time: 0.182267 Nov 08 17:43:29.297086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 417/863] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:29.666966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d6671865-7237-4920-ae22-1ef2eee6f469 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:29.668138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d6671865-7237-4920-ae22-1ef2eee6f469 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:29.674203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d6671865-7237-4920-ae22-1ef2eee6f469 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:29.674683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d6671865-7237-4920-ae22-1ef2eee6f469 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:29.676333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d6671865-7237-4920-ae22-1ef2eee6f469 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:29.676982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d6671865-7237-4920-ae22-1ef2eee6f469 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:29.734866 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d6671865-7237-4920-ae22-1ef2eee6f469 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.071326 Nov 08 17:43:29.735625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 447/864] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:29 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:30.125105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b53db04d-a378-4f13-9525-cc1b18271b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:30.126002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b53db04d-a378-4f13-9525-cc1b18271b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:30.132739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b53db04d-a378-4f13-9525-cc1b18271b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:30.133182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b53db04d-a378-4f13-9525-cc1b18271b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:30.133949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b53db04d-a378-4f13-9525-cc1b18271b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:30.134379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b53db04d-a378-4f13-9525-cc1b18271b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:30.149296 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a9496b88-5b87-4092-9643-19777fd3cbbd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec287ca0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:30.164244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b53db04d-a378-4f13-9525-cc1b18271b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042828 Nov 08 17:43:30.164812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 418/865] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:30.195879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a9496b88-5b87-4092-9643-19777fd3cbbd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051526 Nov 08 17:43:30.196442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 448/866] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:30 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:30.314088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3cc1def7-7434-4cdd-b7d5-706e24711015 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:30.314644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3cc1def7-7434-4cdd-b7d5-706e24711015 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:30.320465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3cc1def7-7434-4cdd-b7d5-706e24711015 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:30.320888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3cc1def7-7434-4cdd-b7d5-706e24711015 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:30.321720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3cc1def7-7434-4cdd-b7d5-706e24711015 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:30.322154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3cc1def7-7434-4cdd-b7d5-706e24711015 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:30.453984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3cc1def7-7434-4cdd-b7d5-706e24711015 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:30.462938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3cc1def7-7434-4cdd-b7d5-706e24711015 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1557 microversion: 2.1 time: 0.152571 Nov 08 17:43:30.463503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 419/867] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:30.745749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c94c2dff-2d9d-4947-a107-2b21aad9f053 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:30.746812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c94c2dff-2d9d-4947-a107-2b21aad9f053 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:30.752888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c94c2dff-2d9d-4947-a107-2b21aad9f053 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:30.753354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c94c2dff-2d9d-4947-a107-2b21aad9f053 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:30.754102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c94c2dff-2d9d-4947-a107-2b21aad9f053 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:30.754571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c94c2dff-2d9d-4947-a107-2b21aad9f053 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:30.810343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c94c2dff-2d9d-4947-a107-2b21aad9f053 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.068779 Nov 08 17:43:30.811068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 449/868] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:30 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:31.176156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6910858f-7103-4bcf-b1b1-4a07f0c71951 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:31.177700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6910858f-7103-4bcf-b1b1-4a07f0c71951 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:31.183950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6910858f-7103-4bcf-b1b1-4a07f0c71951 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:31.184425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6910858f-7103-4bcf-b1b1-4a07f0c71951 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:31.185208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6910858f-7103-4bcf-b1b1-4a07f0c71951 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:31.185644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6910858f-7103-4bcf-b1b1-4a07f0c71951 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:31.208434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6e185be2-f845-44a9-a276-921a1795fd4f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec334700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:31.216099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6910858f-7103-4bcf-b1b1-4a07f0c71951 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044203 Nov 08 17:43:31.216665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 420/869] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:31.256719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6e185be2-f845-44a9-a276-921a1795fd4f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052114 Nov 08 17:43:31.257293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 450/870] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:31 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:31.480608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-51553ec2-c8c2-4248-b8e9-4c0c4073b1f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:31.481212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-51553ec2-c8c2-4248-b8e9-4c0c4073b1f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:31.487033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51553ec2-c8c2-4248-b8e9-4c0c4073b1f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:31.487475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51553ec2-c8c2-4248-b8e9-4c0c4073b1f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:31.488757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51553ec2-c8c2-4248-b8e9-4c0c4073b1f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:31.489187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51553ec2-c8c2-4248-b8e9-4c0c4073b1f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:31.619074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-51553ec2-c8c2-4248-b8e9-4c0c4073b1f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:31.626652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-51553ec2-c8c2-4248-b8e9-4c0c4073b1f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1557 microversion: 2.1 time: 0.149737 Nov 08 17:43:31.629988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 421/871] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:43:31.821509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-30c66c68-745a-4126-b182-38e1aa0f4d52 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:31.822678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-30c66c68-745a-4126-b182-38e1aa0f4d52 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:31.828891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-30c66c68-745a-4126-b182-38e1aa0f4d52 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:31.829338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-30c66c68-745a-4126-b182-38e1aa0f4d52 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:31.830166 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-30c66c68-745a-4126-b182-38e1aa0f4d52 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:31.830740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-30c66c68-745a-4126-b182-38e1aa0f4d52 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:31.894645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-30c66c68-745a-4126-b182-38e1aa0f4d52 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.077139 Nov 08 17:43:31.895200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 451/872] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:31 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 08 17:43:32.228399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-559e26ba-d19a-4141-8d8b-7642716583e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:32.229242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-559e26ba-d19a-4141-8d8b-7642716583e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:32.235491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-559e26ba-d19a-4141-8d8b-7642716583e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:32.235939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-559e26ba-d19a-4141-8d8b-7642716583e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:32.236707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-559e26ba-d19a-4141-8d8b-7642716583e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:32.237133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-559e26ba-d19a-4141-8d8b-7642716583e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:32.266856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-559e26ba-d19a-4141-8d8b-7642716583e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042310 Nov 08 17:43:32.267443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 422/873] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:32.269427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cd6d9b51-67ca-4a2f-999e-57047ff11240 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3c3310>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:32.315176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cd6d9b51-67ca-4a2f-999e-57047ff11240 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049776 Nov 08 17:43:32.315724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 452/874] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:32 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:32.643223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-882ba291-9090-4084-84d8-c77faa5be7f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:32.643825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-882ba291-9090-4084-84d8-c77faa5be7f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:32.649604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-882ba291-9090-4084-84d8-c77faa5be7f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:32.650040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-882ba291-9090-4084-84d8-c77faa5be7f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:32.650821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-882ba291-9090-4084-84d8-c77faa5be7f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:32.651249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-882ba291-9090-4084-84d8-c77faa5be7f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:32.783733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-882ba291-9090-4084-84d8-c77faa5be7f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:43:32.791988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-882ba291-9090-4084-84d8-c77faa5be7f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1563 microversion: 2.1 time: 0.152373 Nov 08 17:43:32.792552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 423/875] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:43:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:32.858754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c54d2403-0daf-4e77-8abd-275a6c334c5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:32.859360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c54d2403-0daf-4e77-8abd-275a6c334c5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:32.865787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c54d2403-0daf-4e77-8abd-275a6c334c5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:32.866238 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c54d2403-0daf-4e77-8abd-275a6c334c5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:32.867038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c54d2403-0daf-4e77-8abd-275a6c334c5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:32.867472 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c54d2403-0daf-4e77-8abd-275a6c334c5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:32.905504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0ab141a8-75f6-495c-9a7a-e43bf4952cbd tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:32.906692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0ab141a8-75f6-495c-9a7a-e43bf4952cbd tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:32.913175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ab141a8-75f6-495c-9a7a-e43bf4952cbd tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:32.922307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ab141a8-75f6-495c-9a7a-e43bf4952cbd tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:32.922307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ab141a8-75f6-495c-9a7a-e43bf4952cbd tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:32.922307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ab141a8-75f6-495c-9a7a-e43bf4952cbd tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:32.949346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.objects.instance [None req-c54d2403-0daf-4e77-8abd-275a6c334c5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lazy-loading 'services' on Instance uuid 76806517-5f8b-4d47-89f6-66e876baa194 {{(pid=127762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:43:32.972946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0ab141a8-75f6-495c-9a7a-e43bf4952cbd tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.070783 Nov 08 17:43:32.973711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 424/876] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:32 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:33.196042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c54d2403-0daf-4e77-8abd-275a6c334c5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "DELETE /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments/f54de683-58ee-4fdd-b244-ddf98021e64d" status: 202 len: 0 microversion: 2.1 time: 0.341196 Nov 08 17:43:33.196539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 453/877] 10.222.0.18 () {58 vars in 1415 bytes} [Mon Nov 8 17:43:32 2021] DELETE /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments/f54de683-58ee-4fdd-b244-ddf98021e64d => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:43:33.205254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-664f2656-d019-4113-b14c-05147e9497d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:33.206239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-664f2656-d019-4113-b14c-05147e9497d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:33.213055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-664f2656-d019-4113-b14c-05147e9497d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:33.213490 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-664f2656-d019-4113-b14c-05147e9497d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:33.214261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-664f2656-d019-4113-b14c-05147e9497d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:33.214728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-664f2656-d019-4113-b14c-05147e9497d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:33.244887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-664f2656-d019-4113-b14c-05147e9497d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Nov 08 17:43:33.246091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 425/878] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:33.278172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bff62374-a153-4a96-968b-47a276141572 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:33.279248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bff62374-a153-4a96-968b-47a276141572 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:33.286044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bff62374-a153-4a96-968b-47a276141572 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:33.286558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bff62374-a153-4a96-968b-47a276141572 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:33.287328 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bff62374-a153-4a96-968b-47a276141572 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:33.287769 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bff62374-a153-4a96-968b-47a276141572 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:33.319521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bff62374-a153-4a96-968b-47a276141572 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045389 Nov 08 17:43:33.320090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 454/879] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:33.327598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6a2df542-6c2b-4c2c-952c-ed0d31c21e4e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2fda60>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:33.402062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6a2df542-6c2b-4c2c-952c-ed0d31c21e4e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.078119 Nov 08 17:43:33.402665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 426/880] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:33 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:33.983585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ed5cd4f3-5801-448c-96ac-653fc78748ea tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:33.989281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ed5cd4f3-5801-448c-96ac-653fc78748ea tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:33.992756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed5cd4f3-5801-448c-96ac-653fc78748ea tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:33.993451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed5cd4f3-5801-448c-96ac-653fc78748ea tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:33.994441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed5cd4f3-5801-448c-96ac-653fc78748ea tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:33.994893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed5cd4f3-5801-448c-96ac-653fc78748ea tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:34.053468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ed5cd4f3-5801-448c-96ac-653fc78748ea tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.073330 Nov 08 17:43:34.054072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 455/881] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:33 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:34.256925 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-94dba443-4992-48f5-8f28-0b9d5bdebf75 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:34.257842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-94dba443-4992-48f5-8f28-0b9d5bdebf75 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:34.264197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-94dba443-4992-48f5-8f28-0b9d5bdebf75 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:34.264632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-94dba443-4992-48f5-8f28-0b9d5bdebf75 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:34.265403 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-94dba443-4992-48f5-8f28-0b9d5bdebf75 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:34.265830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-94dba443-4992-48f5-8f28-0b9d5bdebf75 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:34.294211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-94dba443-4992-48f5-8f28-0b9d5bdebf75 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Nov 08 17:43:34.294778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 427/882] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:34.332439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-193aa4c0-4b5a-4923-a88a-e9b6202ca2ce tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:34.333421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-193aa4c0-4b5a-4923-a88a-e9b6202ca2ce tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:34.340196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-193aa4c0-4b5a-4923-a88a-e9b6202ca2ce tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:34.340634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-193aa4c0-4b5a-4923-a88a-e9b6202ca2ce tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:34.341398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-193aa4c0-4b5a-4923-a88a-e9b6202ca2ce tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:34.341823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-193aa4c0-4b5a-4923-a88a-e9b6202ca2ce tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:34.371490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-193aa4c0-4b5a-4923-a88a-e9b6202ca2ce tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043637 Nov 08 17:43:34.372026 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 456/883] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:34.414710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0c767089-0f77-44c4-afa2-3f7b5756c197 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37cd30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:34.459945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0c767089-0f77-44c4-afa2-3f7b5756c197 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048676 Nov 08 17:43:34.460512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 428/884] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:34 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:35.064081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-75363e5b-104e-4188-816a-99e19aaf8c0a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:35.064997 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-75363e5b-104e-4188-816a-99e19aaf8c0a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:35.071942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-75363e5b-104e-4188-816a-99e19aaf8c0a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:35.072389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-75363e5b-104e-4188-816a-99e19aaf8c0a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:35.073154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-75363e5b-104e-4188-816a-99e19aaf8c0a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:35.073586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-75363e5b-104e-4188-816a-99e19aaf8c0a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:35.136076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-75363e5b-104e-4188-816a-99e19aaf8c0a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.075474 Nov 08 17:43:35.136688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 457/885] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:35 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:35.305678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a47844f7-2ed1-4b21-aab8-987c0204a876 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:35.306524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a47844f7-2ed1-4b21-aab8-987c0204a876 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:35.312882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a47844f7-2ed1-4b21-aab8-987c0204a876 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:35.313325 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a47844f7-2ed1-4b21-aab8-987c0204a876 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:35.314098 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a47844f7-2ed1-4b21-aab8-987c0204a876 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:35.314548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a47844f7-2ed1-4b21-aab8-987c0204a876 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:35.342022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a47844f7-2ed1-4b21-aab8-987c0204a876 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040598 Nov 08 17:43:35.342603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 429/886] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:35.383318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8f3b6a79-ff08-4e35-b8a8-a35bddf4ede3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:35.384301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8f3b6a79-ff08-4e35-b8a8-a35bddf4ede3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:35.391032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8f3b6a79-ff08-4e35-b8a8-a35bddf4ede3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:35.391471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8f3b6a79-ff08-4e35-b8a8-a35bddf4ede3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:35.392230 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8f3b6a79-ff08-4e35-b8a8-a35bddf4ede3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:35.392657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8f3b6a79-ff08-4e35-b8a8-a35bddf4ede3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:35.421638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8f3b6a79-ff08-4e35-b8a8-a35bddf4ede3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042456 Nov 08 17:43:35.422176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 458/887] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:35.471372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-506e2e73-7d72-4a5e-b7ac-7a00384ed6c6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3905e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:35.516550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-506e2e73-7d72-4a5e-b7ac-7a00384ed6c6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048690 Nov 08 17:43:35.517120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 430/888] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:35 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:36.147402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7d64239a-41af-4aee-81ae-577e17d31cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:36.148318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7d64239a-41af-4aee-81ae-577e17d31cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:36.154601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d64239a-41af-4aee-81ae-577e17d31cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:36.155050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d64239a-41af-4aee-81ae-577e17d31cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:36.155830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d64239a-41af-4aee-81ae-577e17d31cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:36.156267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d64239a-41af-4aee-81ae-577e17d31cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:36.221349 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7d64239a-41af-4aee-81ae-577e17d31cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.078020 Nov 08 17:43:36.225575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 459/889] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:36 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:36.354068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-15f7f647-5831-47d5-919d-60c4cf120b2d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:36.354944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-15f7f647-5831-47d5-919d-60c4cf120b2d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:36.361321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15f7f647-5831-47d5-919d-60c4cf120b2d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:36.361768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15f7f647-5831-47d5-919d-60c4cf120b2d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:36.363175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15f7f647-5831-47d5-919d-60c4cf120b2d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:36.363688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-15f7f647-5831-47d5-919d-60c4cf120b2d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:36.391368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-15f7f647-5831-47d5-919d-60c4cf120b2d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Nov 08 17:43:36.391916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 431/890] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:36.433963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3ae21eaf-4304-42c1-bb06-ef758d0cba97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:36.434987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3ae21eaf-4304-42c1-bb06-ef758d0cba97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:36.441813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ae21eaf-4304-42c1-bb06-ef758d0cba97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:36.442255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ae21eaf-4304-42c1-bb06-ef758d0cba97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:36.443063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ae21eaf-4304-42c1-bb06-ef758d0cba97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:36.443497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ae21eaf-4304-42c1-bb06-ef758d0cba97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:36.474200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3ae21eaf-4304-42c1-bb06-ef758d0cba97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044230 Nov 08 17:43:36.474794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 460/891] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:36.529165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9cd7a2f4-d49c-4c0c-8fd6-8a6768d53884 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3905e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:36.573311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9cd7a2f4-d49c-4c0c-8fd6-8a6768d53884 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047766 Nov 08 17:43:36.574087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 432/892] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:36 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:37.234099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-abab6a6f-2ac1-4c9c-806a-79e426b9e50d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:37.235048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-abab6a6f-2ac1-4c9c-806a-79e426b9e50d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:37.242243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abab6a6f-2ac1-4c9c-806a-79e426b9e50d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:37.242669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abab6a6f-2ac1-4c9c-806a-79e426b9e50d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:37.243707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abab6a6f-2ac1-4c9c-806a-79e426b9e50d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:37.244136 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abab6a6f-2ac1-4c9c-806a-79e426b9e50d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:37.304538 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-abab6a6f-2ac1-4c9c-806a-79e426b9e50d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 14 microversion: 2.1 time: 0.073885 Nov 08 17:43:37.305287 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 461/893] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:37 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 08 17:43:37.402100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4786ffce-9b2f-4a07-8012-7656d429494f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:37.403053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4786ffce-9b2f-4a07-8012-7656d429494f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:37.409548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4786ffce-9b2f-4a07-8012-7656d429494f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:37.410019 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4786ffce-9b2f-4a07-8012-7656d429494f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:37.411080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4786ffce-9b2f-4a07-8012-7656d429494f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:37.411657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4786ffce-9b2f-4a07-8012-7656d429494f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:37.440180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4786ffce-9b2f-4a07-8012-7656d429494f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042308 Nov 08 17:43:37.440734 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 433/894] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:37.485413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-12873f55-0159-4dcc-8102-d80e00452129 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:37.486425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-12873f55-0159-4dcc-8102-d80e00452129 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:37.494140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12873f55-0159-4dcc-8102-d80e00452129 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:37.494615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12873f55-0159-4dcc-8102-d80e00452129 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:37.495387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12873f55-0159-4dcc-8102-d80e00452129 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:37.495818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12873f55-0159-4dcc-8102-d80e00452129 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:37.526890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-12873f55-0159-4dcc-8102-d80e00452129 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045417 Nov 08 17:43:37.527459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 462/895] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:37.585199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-95ba6814-353f-456b-bbce-e55b147bbbf5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37caf0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:37.630629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-95ba6814-353f-456b-bbce-e55b147bbbf5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048899 Nov 08 17:43:37.631184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 434/896] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:37 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:38.314964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-09ffb93a-12c7-4fb3-af97-3de4bdbabd59 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:38.315877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-09ffb93a-12c7-4fb3-af97-3de4bdbabd59 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:38.322128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09ffb93a-12c7-4fb3-af97-3de4bdbabd59 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:38.322614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09ffb93a-12c7-4fb3-af97-3de4bdbabd59 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:38.323384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09ffb93a-12c7-4fb3-af97-3de4bdbabd59 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:38.323814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-09ffb93a-12c7-4fb3-af97-3de4bdbabd59 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:38.397122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-09ffb93a-12c7-4fb3-af97-3de4bdbabd59 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 9228 microversion: 2.1 time: 0.085701 Nov 08 17:43:38.397724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 463/897] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:38 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 9228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:43:38.452484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-648575b8-428d-4c96-9bbd-483034ea63c8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:38.453372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-648575b8-428d-4c96-9bbd-483034ea63c8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:38.460001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-648575b8-428d-4c96-9bbd-483034ea63c8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:38.460450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-648575b8-428d-4c96-9bbd-483034ea63c8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:38.461212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-648575b8-428d-4c96-9bbd-483034ea63c8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:38.461641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-648575b8-428d-4c96-9bbd-483034ea63c8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:38.492016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-648575b8-428d-4c96-9bbd-483034ea63c8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Nov 08 17:43:38.492557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 435/898] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:38.539040 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ecfd8c26-f13e-4900-b88e-26b7185bb4c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:38.539951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ecfd8c26-f13e-4900-b88e-26b7185bb4c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:38.546710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecfd8c26-f13e-4900-b88e-26b7185bb4c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:38.547269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecfd8c26-f13e-4900-b88e-26b7185bb4c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:38.548032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecfd8c26-f13e-4900-b88e-26b7185bb4c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:38.548524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecfd8c26-f13e-4900-b88e-26b7185bb4c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:38.577976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ecfd8c26-f13e-4900-b88e-26b7185bb4c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043599 Nov 08 17:43:38.578532 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 464/899] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:38.642629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-51c85de9-9696-4571-af4a-ae34fe00d61e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:38.687340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-51c85de9-9696-4571-af4a-ae34fe00d61e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048241 Nov 08 17:43:38.688084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 436/900] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:38 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:39.408112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a16c8241-de78-4af6-a10c-e83064ce6e42 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:39.409016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a16c8241-de78-4af6-a10c-e83064ce6e42 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:39.416090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a16c8241-de78-4af6-a10c-e83064ce6e42 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:39.416531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a16c8241-de78-4af6-a10c-e83064ce6e42 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:39.417301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a16c8241-de78-4af6-a10c-e83064ce6e42 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:39.417732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a16c8241-de78-4af6-a10c-e83064ce6e42 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:39.494835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a16c8241-de78-4af6-a10c-e83064ce6e42 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 16678 microversion: 2.1 time: 0.090175 Nov 08 17:43:39.495489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 465/901] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:39 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 16678 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:39.503431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-036714a5-5246-40c9-b753-d44991c3083a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:39.504595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-036714a5-5246-40c9-b753-d44991c3083a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:39.510350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-036714a5-5246-40c9-b753-d44991c3083a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:39.510992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-036714a5-5246-40c9-b753-d44991c3083a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:39.511787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-036714a5-5246-40c9-b753-d44991c3083a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:39.512218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-036714a5-5246-40c9-b753-d44991c3083a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:39.541806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-036714a5-5246-40c9-b753-d44991c3083a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 Nov 08 17:43:39.542356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 437/902] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:39.589931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-572e3ec8-8fa6-4ebb-ae0b-58d4363261ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:39.590958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-572e3ec8-8fa6-4ebb-ae0b-58d4363261ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:39.597720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572e3ec8-8fa6-4ebb-ae0b-58d4363261ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:39.598887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572e3ec8-8fa6-4ebb-ae0b-58d4363261ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:39.599655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572e3ec8-8fa6-4ebb-ae0b-58d4363261ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:39.600079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572e3ec8-8fa6-4ebb-ae0b-58d4363261ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:39.628810 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-572e3ec8-8fa6-4ebb-ae0b-58d4363261ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042950 Nov 08 17:43:39.629374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 466/903] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:39.699234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3670c491-dccf-4103-91ee-2f376cf5d748 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec384dc0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:39.744051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3670c491-dccf-4103-91ee-2f376cf5d748 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048349 Nov 08 17:43:39.744604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 438/904] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:39 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:40.506254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6285c6d0-007d-479d-a259-2b3a15b97a4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:40.507234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6285c6d0-007d-479d-a259-2b3a15b97a4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:40.513404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6285c6d0-007d-479d-a259-2b3a15b97a4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:40.513840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6285c6d0-007d-479d-a259-2b3a15b97a4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:40.514632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6285c6d0-007d-479d-a259-2b3a15b97a4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:40.515058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6285c6d0-007d-479d-a259-2b3a15b97a4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:40.554099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7ef0a06c-831a-4fb2-9083-06ba19cdc503 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:40.554938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7ef0a06c-831a-4fb2-9083-06ba19cdc503 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:40.561113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ef0a06c-831a-4fb2-9083-06ba19cdc503 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:40.561549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ef0a06c-831a-4fb2-9083-06ba19cdc503 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:40.562308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ef0a06c-831a-4fb2-9083-06ba19cdc503 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:40.562764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ef0a06c-831a-4fb2-9083-06ba19cdc503 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:40.590705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7ef0a06c-831a-4fb2-9083-06ba19cdc503 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041372 Nov 08 17:43:40.591252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 439/905] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:40.605150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6285c6d0-007d-479d-a259-2b3a15b97a4f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 18663 microversion: 2.1 time: 0.102490 Nov 08 17:43:40.605785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 467/906] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:40 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 18663 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:40.640422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7a790e28-7454-4a1f-8934-b0a9fba2aad0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:40.641442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7a790e28-7454-4a1f-8934-b0a9fba2aad0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:40.647468 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a790e28-7454-4a1f-8934-b0a9fba2aad0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:40.647943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a790e28-7454-4a1f-8934-b0a9fba2aad0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:40.648719 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a790e28-7454-4a1f-8934-b0a9fba2aad0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:40.649147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a790e28-7454-4a1f-8934-b0a9fba2aad0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:40.678264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7a790e28-7454-4a1f-8934-b0a9fba2aad0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041567 Nov 08 17:43:40.678849 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 440/907] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:40.756183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f848699c-a2a5-4f70-b84a-32a1ccb7d71a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec335e50>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:40.801005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f848699c-a2a5-4f70-b84a-32a1ccb7d71a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048725 Nov 08 17:43:40.801565 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 468/908] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:40 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:41.601400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f221aa33-55b0-4f40-86d1-afdd2a8e881f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:41.602219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f221aa33-55b0-4f40-86d1-afdd2a8e881f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:41.608470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f221aa33-55b0-4f40-86d1-afdd2a8e881f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:41.608915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f221aa33-55b0-4f40-86d1-afdd2a8e881f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:41.609687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f221aa33-55b0-4f40-86d1-afdd2a8e881f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:41.610122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f221aa33-55b0-4f40-86d1-afdd2a8e881f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:41.616642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c17d2253-6196-4c3d-8949-9a16f8fa6244 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:41.617916 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c17d2253-6196-4c3d-8949-9a16f8fa6244 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:41.623935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c17d2253-6196-4c3d-8949-9a16f8fa6244 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:41.624373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c17d2253-6196-4c3d-8949-9a16f8fa6244 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:41.625139 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c17d2253-6196-4c3d-8949-9a16f8fa6244 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:41.625561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c17d2253-6196-4c3d-8949-9a16f8fa6244 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:41.639824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f221aa33-55b0-4f40-86d1-afdd2a8e881f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042423 Nov 08 17:43:41.640389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 441/909] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:41.688920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4a394490-2770-46b4-b923-e6c27a4a98f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:41.689824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4a394490-2770-46b4-b923-e6c27a4a98f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:41.696377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a394490-2770-46b4-b923-e6c27a4a98f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:41.696818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a394490-2770-46b4-b923-e6c27a4a98f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:41.697574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a394490-2770-46b4-b923-e6c27a4a98f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:41.698001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a394490-2770-46b4-b923-e6c27a4a98f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:41.710990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c17d2253-6196-4c3d-8949-9a16f8fa6244 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 20997 microversion: 2.1 time: 0.098558 Nov 08 17:43:41.713112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 469/910] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:41 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 20997 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:41.725795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4a394490-2770-46b4-b923-e6c27a4a98f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040651 Nov 08 17:43:41.726335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 442/911] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:41.813842 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ab393f79-7f06-4899-9640-82139accc3be tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3734c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:41.858641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ab393f79-7f06-4899-9640-82139accc3be tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048595 Nov 08 17:43:41.859193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 470/912] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:41 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:42.651595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9dde6dee-b7b2-4483-9278-e50c83ebf0f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:42.652487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9dde6dee-b7b2-4483-9278-e50c83ebf0f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:42.658688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9dde6dee-b7b2-4483-9278-e50c83ebf0f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:42.659128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9dde6dee-b7b2-4483-9278-e50c83ebf0f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:42.659888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9dde6dee-b7b2-4483-9278-e50c83ebf0f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:42.660311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9dde6dee-b7b2-4483-9278-e50c83ebf0f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:42.688430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9dde6dee-b7b2-4483-9278-e50c83ebf0f7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040635 Nov 08 17:43:42.688975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 443/913] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:42.722800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3d89aaf9-9f12-4a35-aa9c-542752078f53 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:42.724785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3d89aaf9-9f12-4a35-aa9c-542752078f53 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:42.730910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3d89aaf9-9f12-4a35-aa9c-542752078f53 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:42.731354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3d89aaf9-9f12-4a35-aa9c-542752078f53 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:42.732125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3d89aaf9-9f12-4a35-aa9c-542752078f53 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:42.732562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3d89aaf9-9f12-4a35-aa9c-542752078f53 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:42.736699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-00df0a7c-b288-4d5b-8a2d-41b664804ea7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:42.737585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-00df0a7c-b288-4d5b-8a2d-41b664804ea7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:42.743520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-00df0a7c-b288-4d5b-8a2d-41b664804ea7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:42.743956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-00df0a7c-b288-4d5b-8a2d-41b664804ea7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:42.744722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-00df0a7c-b288-4d5b-8a2d-41b664804ea7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:42.745148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-00df0a7c-b288-4d5b-8a2d-41b664804ea7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:42.774853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-00df0a7c-b288-4d5b-8a2d-41b664804ea7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041674 Nov 08 17:43:42.775409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 444/914] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:42.815977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3d89aaf9-9f12-4a35-aa9c-542752078f53 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 22988 microversion: 2.1 time: 0.097369 Nov 08 17:43:42.816620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 471/915] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:42 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 22988 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:42.870720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a4ae6775-3d70-402f-b6db-70c2e585f3e7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec384dc0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:42.915659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a4ae6775-3d70-402f-b6db-70c2e585f3e7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048762 Nov 08 17:43:42.916222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 445/916] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:42 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:43.700341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0e0d729b-aabe-4ae5-8039-6133ce17bd38 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:43.701336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0e0d729b-aabe-4ae5-8039-6133ce17bd38 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:43.708209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e0d729b-aabe-4ae5-8039-6133ce17bd38 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:43.708750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e0d729b-aabe-4ae5-8039-6133ce17bd38 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:43.709524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e0d729b-aabe-4ae5-8039-6133ce17bd38 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:43.709963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e0d729b-aabe-4ae5-8039-6133ce17bd38 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:43.741220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0e0d729b-aabe-4ae5-8039-6133ce17bd38 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Nov 08 17:43:43.741871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 472/917] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:43.787082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-78edce1f-8a17-419d-b153-789c441ae996 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:43.787972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-78edce1f-8a17-419d-b153-789c441ae996 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:43.794429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78edce1f-8a17-419d-b153-789c441ae996 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:43.794891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78edce1f-8a17-419d-b153-789c441ae996 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:43.795653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78edce1f-8a17-419d-b153-789c441ae996 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:43.796077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78edce1f-8a17-419d-b153-789c441ae996 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:43.826264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-78edce1f-8a17-419d-b153-789c441ae996 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043850 Nov 08 17:43:43.826846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 446/918] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:43.827879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6b5150d7-b313-4b44-a047-2c2d2e6f4b9d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:43.828795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6b5150d7-b313-4b44-a047-2c2d2e6f4b9d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:43.835356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b5150d7-b313-4b44-a047-2c2d2e6f4b9d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:43.835809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b5150d7-b313-4b44-a047-2c2d2e6f4b9d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:43.836590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b5150d7-b313-4b44-a047-2c2d2e6f4b9d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:43.837027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b5150d7-b313-4b44-a047-2c2d2e6f4b9d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:43.915759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6b5150d7-b313-4b44-a047-2c2d2e6f4b9d tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 24271 microversion: 2.1 time: 0.091295 Nov 08 17:43:43.916596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 473/919] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:43 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 24271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:43.927947 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ca3ec361-000e-4276-a4bf-e2784dba174b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2a1ee0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:43.971954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ca3ec361-000e-4276-a4bf-e2784dba174b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047964 Nov 08 17:43:43.972512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 447/920] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:43 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:44.752878 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bc28432a-408d-4e7a-8479-948c36182fa8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:44.753783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bc28432a-408d-4e7a-8479-948c36182fa8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:44.761233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc28432a-408d-4e7a-8479-948c36182fa8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:44.761673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc28432a-408d-4e7a-8479-948c36182fa8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:44.762443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc28432a-408d-4e7a-8479-948c36182fa8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:44.762884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc28432a-408d-4e7a-8479-948c36182fa8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:44.791132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bc28432a-408d-4e7a-8479-948c36182fa8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042458 Nov 08 17:43:44.791669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 474/921] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:44.838028 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-468c1ef5-3806-4146-8a74-0d5b4dfc2f46 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:44.838993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-468c1ef5-3806-4146-8a74-0d5b4dfc2f46 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:44.846381 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-468c1ef5-3806-4146-8a74-0d5b4dfc2f46 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:44.846865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-468c1ef5-3806-4146-8a74-0d5b4dfc2f46 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:44.847636 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-468c1ef5-3806-4146-8a74-0d5b4dfc2f46 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:44.848068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-468c1ef5-3806-4146-8a74-0d5b4dfc2f46 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:44.876207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-468c1ef5-3806-4146-8a74-0d5b4dfc2f46 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042589 Nov 08 17:43:44.876760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 448/922] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:44.927566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6b4b0be3-e397-467d-b6bd-b4982e2db19c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:44.928554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6b4b0be3-e397-467d-b6bd-b4982e2db19c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:44.934773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b4b0be3-e397-467d-b6bd-b4982e2db19c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:44.939608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b4b0be3-e397-467d-b6bd-b4982e2db19c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:44.939608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b4b0be3-e397-467d-b6bd-b4982e2db19c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:44.939608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b4b0be3-e397-467d-b6bd-b4982e2db19c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:44.984040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3f804468-5e79-4b01-b48c-1042fa1250b6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3531f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:45.009943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6b4b0be3-e397-467d-b6bd-b4982e2db19c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 25587 microversion: 2.1 time: 0.086297 Nov 08 17:43:45.010718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 475/923] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:44 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 25587 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:45.032115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3f804468-5e79-4b01-b48c-1042fa1250b6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051620 Nov 08 17:43:45.032679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 449/924] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:44 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:45.803730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-30015f05-178e-4338-a802-cc5ab0187305 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:45.805252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-30015f05-178e-4338-a802-cc5ab0187305 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:45.812160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-30015f05-178e-4338-a802-cc5ab0187305 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:45.812665 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-30015f05-178e-4338-a802-cc5ab0187305 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:45.813432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-30015f05-178e-4338-a802-cc5ab0187305 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:45.813860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-30015f05-178e-4338-a802-cc5ab0187305 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:45.842622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-30015f05-178e-4338-a802-cc5ab0187305 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043100 Nov 08 17:43:45.843172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 476/925] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:45.888647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c9bdc4d8-4ab1-4b24-8451-e53aae3eeaca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:45.889541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c9bdc4d8-4ab1-4b24-8451-e53aae3eeaca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:45.895412 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c9bdc4d8-4ab1-4b24-8451-e53aae3eeaca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:45.896118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c9bdc4d8-4ab1-4b24-8451-e53aae3eeaca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:45.896818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c9bdc4d8-4ab1-4b24-8451-e53aae3eeaca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:45.897250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c9bdc4d8-4ab1-4b24-8451-e53aae3eeaca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:45.926050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c9bdc4d8-4ab1-4b24-8451-e53aae3eeaca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041652 Nov 08 17:43:45.926756 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 450/926] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:46.021717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-83b86952-10c6-4494-985d-ea28ce80424f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:46.022708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-83b86952-10c6-4494-985d-ea28ce80424f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:46.028861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83b86952-10c6-4494-985d-ea28ce80424f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:46.029320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83b86952-10c6-4494-985d-ea28ce80424f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:46.030089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83b86952-10c6-4494-985d-ea28ce80424f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:46.030558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83b86952-10c6-4494-985d-ea28ce80424f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:46.044120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0e4bbbfb-bcb0-42bd-a3d1-ef29636fef53 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2a10d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:46.088757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0e4bbbfb-bcb0-42bd-a3d1-ef29636fef53 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048141 Nov 08 17:43:46.089320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 451/927] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:46 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:46.107732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-83b86952-10c6-4494-985d-ea28ce80424f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 26965 microversion: 2.1 time: 0.090215 Nov 08 17:43:46.108369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 477/928] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:46 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 26965 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:46.853119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a7567ef7-392b-447f-a487-449e941fff6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:46.853940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a7567ef7-392b-447f-a487-449e941fff6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:46.859982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7567ef7-392b-447f-a487-449e941fff6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:46.860419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7567ef7-392b-447f-a487-449e941fff6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:46.861212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7567ef7-392b-447f-a487-449e941fff6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:46.862420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7567ef7-392b-447f-a487-449e941fff6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:46.896775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a7567ef7-392b-447f-a487-449e941fff6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047485 Nov 08 17:43:46.897388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 452/929] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:46.945364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9839bbff-31da-4ffb-b20b-8494f5d42f81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:46.946349 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9839bbff-31da-4ffb-b20b-8494f5d42f81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:46.953160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9839bbff-31da-4ffb-b20b-8494f5d42f81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:46.953602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9839bbff-31da-4ffb-b20b-8494f5d42f81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:46.954364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9839bbff-31da-4ffb-b20b-8494f5d42f81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:46.954817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9839bbff-31da-4ffb-b20b-8494f5d42f81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:46.983236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9839bbff-31da-4ffb-b20b-8494f5d42f81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042799 Nov 08 17:43:46.983783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 478/930] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:47.100954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ebba36eb-c3d2-4f5b-92c0-8580838f6e8a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3840d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:47.119994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2f27caf7-cbb7-4577-b170-86729f1eac0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:47.121010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2f27caf7-cbb7-4577-b170-86729f1eac0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:47.127248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f27caf7-cbb7-4577-b170-86729f1eac0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:47.127697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f27caf7-cbb7-4577-b170-86729f1eac0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:47.128519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f27caf7-cbb7-4577-b170-86729f1eac0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:47.128956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f27caf7-cbb7-4577-b170-86729f1eac0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:47.213734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2f27caf7-cbb7-4577-b170-86729f1eac0f tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 27667 microversion: 2.1 time: 0.097758 Nov 08 17:43:47.217594 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 479/931] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:47 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 27667 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:47.263336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ebba36eb-c3d2-4f5b-92c0-8580838f6e8a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.166084 Nov 08 17:43:47.263938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 453/932] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:47 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:47.908583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6eb5d16c-cf3b-4b04-b17c-6bbfb42d79ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:47.909604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6eb5d16c-cf3b-4b04-b17c-6bbfb42d79ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:47.916425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6eb5d16c-cf3b-4b04-b17c-6bbfb42d79ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:47.916869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6eb5d16c-cf3b-4b04-b17c-6bbfb42d79ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:47.917670 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6eb5d16c-cf3b-4b04-b17c-6bbfb42d79ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:47.918098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6eb5d16c-cf3b-4b04-b17c-6bbfb42d79ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:47.950491 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6eb5d16c-cf3b-4b04-b17c-6bbfb42d79ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045955 Nov 08 17:43:47.951118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 480/933] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:47.996014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-506336b2-c178-432d-881e-38d0430fe815 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:47.996905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-506336b2-c178-432d-881e-38d0430fe815 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:48.003377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-506336b2-c178-432d-881e-38d0430fe815 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:48.003879 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-506336b2-c178-432d-881e-38d0430fe815 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:48.004648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-506336b2-c178-432d-881e-38d0430fe815 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:48.005083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-506336b2-c178-432d-881e-38d0430fe815 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:48.032938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-506336b2-c178-432d-881e-38d0430fe815 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041507 Nov 08 17:43:48.033488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 454/934] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:48.225200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-766a2120-4fcb-41bc-bbad-fc95fce69210 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:48.226058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-766a2120-4fcb-41bc-bbad-fc95fce69210 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:48.232317 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-766a2120-4fcb-41bc-bbad-fc95fce69210 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:48.232763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-766a2120-4fcb-41bc-bbad-fc95fce69210 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:48.233531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-766a2120-4fcb-41bc-bbad-fc95fce69210 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:48.233964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-766a2120-4fcb-41bc-bbad-fc95fce69210 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:48.275116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-727b2fe0-c358-437d-946f-3a0c85ab9e14 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3840d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:48.319186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-727b2fe0-c358-437d-946f-3a0c85ab9e14 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047511 Nov 08 17:43:48.319752 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 455/935] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:48 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:48.322554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-766a2120-4fcb-41bc-bbad-fc95fce69210 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 28135 microversion: 2.1 time: 0.100926 Nov 08 17:43:48.323207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 481/936] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:48 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 28135 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:48.962612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ff7c7ad3-5cd5-45b3-ac8d-51d5ae801679 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:48.963524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ff7c7ad3-5cd5-45b3-ac8d-51d5ae801679 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:48.969454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ff7c7ad3-5cd5-45b3-ac8d-51d5ae801679 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:48.969893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ff7c7ad3-5cd5-45b3-ac8d-51d5ae801679 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:48.970690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ff7c7ad3-5cd5-45b3-ac8d-51d5ae801679 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:48.971118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ff7c7ad3-5cd5-45b3-ac8d-51d5ae801679 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:49.000227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ff7c7ad3-5cd5-45b3-ac8d-51d5ae801679 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Nov 08 17:43:49.000897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 456/937] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:49.045083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-68fbfa90-d02a-4b79-8761-44092cb93820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:49.046068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-68fbfa90-d02a-4b79-8761-44092cb93820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:49.052874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68fbfa90-d02a-4b79-8761-44092cb93820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:49.053314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68fbfa90-d02a-4b79-8761-44092cb93820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:49.054076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68fbfa90-d02a-4b79-8761-44092cb93820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:49.054526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68fbfa90-d02a-4b79-8761-44092cb93820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:49.083839 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-68fbfa90-d02a-4b79-8761-44092cb93820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042391 Nov 08 17:43:49.084436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 482/938] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:49.331488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a9cf2878-3d3b-454f-8989-b123feaf58f3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd9d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:49.332753 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-62040a5a-8753-4fbb-a484-4ac4104d6951 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:49.333667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-62040a5a-8753-4fbb-a484-4ac4104d6951 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:49.340052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62040a5a-8753-4fbb-a484-4ac4104d6951 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:49.340489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62040a5a-8753-4fbb-a484-4ac4104d6951 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:49.341252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62040a5a-8753-4fbb-a484-4ac4104d6951 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:49.341678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62040a5a-8753-4fbb-a484-4ac4104d6951 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:49.375850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a9cf2878-3d3b-454f-8989-b123feaf58f3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048223 Nov 08 17:43:49.376419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 457/939] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:49 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:49.422983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-62040a5a-8753-4fbb-a484-4ac4104d6951 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 28197 microversion: 2.1 time: 0.093618 Nov 08 17:43:49.423637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 483/940] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:49 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 28197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:49.436486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:43:49.436621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 17:43:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:43:50.012281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dba4f734-eaed-4664-aadf-2508c2ab6d5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:50.014989 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dba4f734-eaed-4664-aadf-2508c2ab6d5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:50.019620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dba4f734-eaed-4664-aadf-2508c2ab6d5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:50.020075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dba4f734-eaed-4664-aadf-2508c2ab6d5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:50.020933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dba4f734-eaed-4664-aadf-2508c2ab6d5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:50.021371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dba4f734-eaed-4664-aadf-2508c2ab6d5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:50.049243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dba4f734-eaed-4664-aadf-2508c2ab6d5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041153 Nov 08 17:43:50.049803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 458/941] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:50.095984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-102c13bd-f783-4fa1-b120-ad0d9806ef67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:50.096969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-102c13bd-f783-4fa1-b120-ad0d9806ef67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:50.104738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-102c13bd-f783-4fa1-b120-ad0d9806ef67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:50.105181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-102c13bd-f783-4fa1-b120-ad0d9806ef67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:50.105951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-102c13bd-f783-4fa1-b120-ad0d9806ef67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:50.106382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-102c13bd-f783-4fa1-b120-ad0d9806ef67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:50.135428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-102c13bd-f783-4fa1-b120-ad0d9806ef67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043545 Nov 08 17:43:50.135961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 484/942] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:50.388214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ea9cf739-0773-4cad-b1f6-ee8f43c03b47 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec353dc0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:50.432879 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ea9cf739-0773-4cad-b1f6-ee8f43c03b47 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048212 Nov 08 17:43:50.433453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 459/943] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:50 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:50.435316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-baf86217-9610-42a0-b5c2-2ea0581b65f9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:50.436310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-baf86217-9610-42a0-b5c2-2ea0581b65f9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:50.443066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-baf86217-9610-42a0-b5c2-2ea0581b65f9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:50.443512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-baf86217-9610-42a0-b5c2-2ea0581b65f9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:50.444275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-baf86217-9610-42a0-b5c2-2ea0581b65f9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:50.444701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-baf86217-9610-42a0-b5c2-2ea0581b65f9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:50.532942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-baf86217-9610-42a0-b5c2-2ea0581b65f9 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 28488 microversion: 2.1 time: 0.101380 Nov 08 17:43:50.533798 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 485/944] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:50 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 28488 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:43:51.061530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-945b5dea-6e50-4320-ac3e-279cab2b27e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:51.062425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-945b5dea-6e50-4320-ac3e-279cab2b27e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:51.070641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-945b5dea-6e50-4320-ac3e-279cab2b27e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:51.071092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-945b5dea-6e50-4320-ac3e-279cab2b27e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:51.071866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-945b5dea-6e50-4320-ac3e-279cab2b27e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:51.072300 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-945b5dea-6e50-4320-ac3e-279cab2b27e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:51.100621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-945b5dea-6e50-4320-ac3e-279cab2b27e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 Nov 08 17:43:51.101178 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 460/945] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:51.147346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0ffe849f-57c9-448e-b87a-3f87b70a9682 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:51.148336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0ffe849f-57c9-448e-b87a-3f87b70a9682 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:51.155174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ffe849f-57c9-448e-b87a-3f87b70a9682 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:51.155618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ffe849f-57c9-448e-b87a-3f87b70a9682 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:51.156391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ffe849f-57c9-448e-b87a-3f87b70a9682 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:51.156826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ffe849f-57c9-448e-b87a-3f87b70a9682 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:51.186336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0ffe849f-57c9-448e-b87a-3f87b70a9682 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043160 Nov 08 17:43:51.186919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 486/946] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:51.444846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-10d13ed8-32ec-4587-a77f-5181ba1a6cbd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2fd1f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:51.490169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-10d13ed8-32ec-4587-a77f-5181ba1a6cbd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049019 Nov 08 17:43:51.490776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 461/947] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:51 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:51.545063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f6858c07-1621-4fba-bc58-3569fd2d1d6b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:51.545974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f6858c07-1621-4fba-bc58-3569fd2d1d6b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:51.552543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6858c07-1621-4fba-bc58-3569fd2d1d6b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:51.552995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6858c07-1621-4fba-bc58-3569fd2d1d6b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:51.553770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6858c07-1621-4fba-bc58-3569fd2d1d6b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:51.554206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6858c07-1621-4fba-bc58-3569fd2d1d6b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:51.635885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f6858c07-1621-4fba-bc58-3569fd2d1d6b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 28656 microversion: 2.1 time: 0.094438 Nov 08 17:43:51.636498 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 487/948] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:51 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 28656 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:52.111921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-570a5297-d32b-4c9a-beab-fb6969e8e2d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:52.112822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-570a5297-d32b-4c9a-beab-fb6969e8e2d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:52.119942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-570a5297-d32b-4c9a-beab-fb6969e8e2d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:52.120383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-570a5297-d32b-4c9a-beab-fb6969e8e2d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:52.121150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-570a5297-d32b-4c9a-beab-fb6969e8e2d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:52.121580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-570a5297-d32b-4c9a-beab-fb6969e8e2d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:52.150063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-570a5297-d32b-4c9a-beab-fb6969e8e2d0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042368 Nov 08 17:43:52.150629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 462/949] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:52.198092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-04ed3791-b227-4454-82a7-4fafcd80a20c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:52.199157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-04ed3791-b227-4454-82a7-4fafcd80a20c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:52.205917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04ed3791-b227-4454-82a7-4fafcd80a20c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:52.206359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04ed3791-b227-4454-82a7-4fafcd80a20c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:52.207168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04ed3791-b227-4454-82a7-4fafcd80a20c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:52.207634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04ed3791-b227-4454-82a7-4fafcd80a20c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:52.245868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-04ed3791-b227-4454-82a7-4fafcd80a20c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051503 Nov 08 17:43:52.246391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 488/950] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:52.502277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-58df98c1-b857-4e3a-9b0b-1b4f259e3f0c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:52.546968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-58df98c1-b857-4e3a-9b0b-1b4f259e3f0c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048282 Nov 08 17:43:52.547516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 463/951] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:52 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:52.647782 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-74e8d304-ee03-444b-b08b-04ac866d25ca tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:52.648679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-74e8d304-ee03-444b-b08b-04ac866d25ca tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:52.654796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74e8d304-ee03-444b-b08b-04ac866d25ca tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:52.655232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74e8d304-ee03-444b-b08b-04ac866d25ca tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:52.655988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74e8d304-ee03-444b-b08b-04ac866d25ca tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:52.656416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74e8d304-ee03-444b-b08b-04ac866d25ca tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:52.718357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-74e8d304-ee03-444b-b08b-04ac866d25ca tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 28656 microversion: 2.1 time: 0.074533 Nov 08 17:43:52.719028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 489/952] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:52 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 28656 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:53.161431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a6893f83-e328-45ad-b225-7a835854ad57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:53.162325 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a6893f83-e328-45ad-b225-7a835854ad57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:53.169215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6893f83-e328-45ad-b225-7a835854ad57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:53.169686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6893f83-e328-45ad-b225-7a835854ad57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:53.170406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6893f83-e328-45ad-b225-7a835854ad57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:53.170860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6893f83-e328-45ad-b225-7a835854ad57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:53.199354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a6893f83-e328-45ad-b225-7a835854ad57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042055 Nov 08 17:43:53.199917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 464/953] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:53.259738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1b1860f0-5a3e-4ce2-9b6b-5654f8947b63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:53.260712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1b1860f0-5a3e-4ce2-9b6b-5654f8947b63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:53.267002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b1860f0-5a3e-4ce2-9b6b-5654f8947b63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:53.267444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b1860f0-5a3e-4ce2-9b6b-5654f8947b63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:53.268202 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b1860f0-5a3e-4ce2-9b6b-5654f8947b63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:53.268624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b1860f0-5a3e-4ce2-9b6b-5654f8947b63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:53.297674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1b1860f0-5a3e-4ce2-9b6b-5654f8947b63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043039 Nov 08 17:43:53.298222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 490/954] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:53.559608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-257cedfb-b000-4748-ade9-171be1850679 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c0c10>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:53.604905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-257cedfb-b000-4748-ade9-171be1850679 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048859 Nov 08 17:43:53.605496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 465/955] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:53 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:53.729907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ef227466-8538-460b-9c11-412a6e335f9a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:53.730844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ef227466-8538-460b-9c11-412a6e335f9a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:53.737045 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ef227466-8538-460b-9c11-412a6e335f9a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:53.737486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ef227466-8538-460b-9c11-412a6e335f9a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:53.738250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ef227466-8538-460b-9c11-412a6e335f9a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:53.738711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ef227466-8538-460b-9c11-412a6e335f9a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:53.800869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ef227466-8538-460b-9c11-412a6e335f9a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 28656 microversion: 2.1 time: 0.074444 Nov 08 17:43:53.804237 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 491/956] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:53 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 28656 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:54.211141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6108df3d-258e-4622-a79e-ff8e1c9f1835 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:54.212048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6108df3d-258e-4622-a79e-ff8e1c9f1835 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:54.218425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6108df3d-258e-4622-a79e-ff8e1c9f1835 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:54.218901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6108df3d-258e-4622-a79e-ff8e1c9f1835 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:54.219664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6108df3d-258e-4622-a79e-ff8e1c9f1835 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:54.220094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6108df3d-258e-4622-a79e-ff8e1c9f1835 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:54.249341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6108df3d-258e-4622-a79e-ff8e1c9f1835 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Nov 08 17:43:54.249891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 466/957] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:54.409154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0f185c75-b6d1-4f2b-a603-325b7906fac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:54.410233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0f185c75-b6d1-4f2b-a603-325b7906fac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:54.418041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f185c75-b6d1-4f2b-a603-325b7906fac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:54.418518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f185c75-b6d1-4f2b-a603-325b7906fac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:54.419293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f185c75-b6d1-4f2b-a603-325b7906fac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:54.419731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f185c75-b6d1-4f2b-a603-325b7906fac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:54.447691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0f185c75-b6d1-4f2b-a603-325b7906fac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.142045 Nov 08 17:43:54.448243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 492/958] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:54.616870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-67372822-cd5c-4c4a-a436-619a28e8bc66 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec31ce50>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:54.661569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-67372822-cd5c-4c4a-a436-619a28e8bc66 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048319 Nov 08 17:43:54.662817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 467/959] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:54 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:54.813279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-47e8155e-b10a-4370-846b-b9b9ecd6c828 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:54.814209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-47e8155e-b10a-4370-846b-b9b9ecd6c828 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:54.820952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47e8155e-b10a-4370-846b-b9b9ecd6c828 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:54.821390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47e8155e-b10a-4370-846b-b9b9ecd6c828 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:54.822151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47e8155e-b10a-4370-846b-b9b9ecd6c828 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:54.822608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47e8155e-b10a-4370-846b-b9b9ecd6c828 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:54.894851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-47e8155e-b10a-4370-846b-b9b9ecd6c828 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 28656 microversion: 2.1 time: 0.085004 Nov 08 17:43:54.896158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 493/960] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:54 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 28656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:55.261979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dcc3e18e-b77f-4f78-9ce2-0dc136163527 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:55.262818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dcc3e18e-b77f-4f78-9ce2-0dc136163527 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:55.269165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcc3e18e-b77f-4f78-9ce2-0dc136163527 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:55.269608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcc3e18e-b77f-4f78-9ce2-0dc136163527 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:55.270579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcc3e18e-b77f-4f78-9ce2-0dc136163527 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:55.271016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcc3e18e-b77f-4f78-9ce2-0dc136163527 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:55.298962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dcc3e18e-b77f-4f78-9ce2-0dc136163527 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041305 Nov 08 17:43:55.299505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 468/961] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:55.459864 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-93371b08-2f07-45d7-8aa7-e03a219b70a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:55.460866 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-93371b08-2f07-45d7-8aa7-e03a219b70a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:55.467714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93371b08-2f07-45d7-8aa7-e03a219b70a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:55.468160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93371b08-2f07-45d7-8aa7-e03a219b70a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:55.468939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93371b08-2f07-45d7-8aa7-e03a219b70a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:55.469376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93371b08-2f07-45d7-8aa7-e03a219b70a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:55.502764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-93371b08-2f07-45d7-8aa7-e03a219b70a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047060 Nov 08 17:43:55.503338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 494/962] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:55.674245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6cf5f877-10c1-4d8b-b375-bc0b3018e784 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2a1280>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:55.719610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6cf5f877-10c1-4d8b-b375-bc0b3018e784 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048801 Nov 08 17:43:55.720248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 469/963] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:55 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:55.907329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-757a1aa8-8104-4224-b98c-9a3a30aff374 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:55.908922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-757a1aa8-8104-4224-b98c-9a3a30aff374 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:55.924061 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-757a1aa8-8104-4224-b98c-9a3a30aff374 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:55.924886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-757a1aa8-8104-4224-b98c-9a3a30aff374 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:55.925261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-757a1aa8-8104-4224-b98c-9a3a30aff374 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:55.925687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-757a1aa8-8104-4224-b98c-9a3a30aff374 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:56.006726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-757a1aa8-8104-4224-b98c-9a3a30aff374 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 29425 microversion: 2.1 time: 0.103295 Nov 08 17:43:56.010601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 495/964] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:55 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 29425 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:56.311427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7638a2b1-0c85-4da9-9caf-3e4d86c88c4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:56.312325 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7638a2b1-0c85-4da9-9caf-3e4d86c88c4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:56.319478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7638a2b1-0c85-4da9-9caf-3e4d86c88c4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:56.319922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7638a2b1-0c85-4da9-9caf-3e4d86c88c4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:56.320712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7638a2b1-0c85-4da9-9caf-3e4d86c88c4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:56.321140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7638a2b1-0c85-4da9-9caf-3e4d86c88c4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:56.349569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7638a2b1-0c85-4da9-9caf-3e4d86c88c4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 Nov 08 17:43:56.350124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 470/965] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:56.515034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ed9ff733-618c-487e-916d-205cbfa1509f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:56.516017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ed9ff733-618c-487e-916d-205cbfa1509f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:56.523486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed9ff733-618c-487e-916d-205cbfa1509f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:56.523923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed9ff733-618c-487e-916d-205cbfa1509f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:56.524682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed9ff733-618c-487e-916d-205cbfa1509f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:56.525107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed9ff733-618c-487e-916d-205cbfa1509f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:56.555276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ed9ff733-618c-487e-916d-205cbfa1509f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044408 Nov 08 17:43:56.555828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 496/966] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:56.732494 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4f99ee9c-77be-4dab-9315-1a72fa3fcdd3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2a1b80>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:56.778272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4f99ee9c-77be-4dab-9315-1a72fa3fcdd3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049327 Nov 08 17:43:56.778866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 471/967] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:56 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:57.018131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ebac1705-e3eb-48bb-8377-fb48be35294b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:57.019079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ebac1705-e3eb-48bb-8377-fb48be35294b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:57.025547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ebac1705-e3eb-48bb-8377-fb48be35294b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:57.025990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ebac1705-e3eb-48bb-8377-fb48be35294b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:57.026794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ebac1705-e3eb-48bb-8377-fb48be35294b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:57.027226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ebac1705-e3eb-48bb-8377-fb48be35294b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:57.110601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ebac1705-e3eb-48bb-8377-fb48be35294b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 31367 microversion: 2.1 time: 0.095976 Nov 08 17:43:57.111228 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 497/968] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:57 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 31367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:57.360949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-405f8ae7-7abe-4975-944d-602c106a7230 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:57.361766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-405f8ae7-7abe-4975-944d-602c106a7230 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:57.370570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-405f8ae7-7abe-4975-944d-602c106a7230 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:57.371017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-405f8ae7-7abe-4975-944d-602c106a7230 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:57.371783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-405f8ae7-7abe-4975-944d-602c106a7230 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:57.372210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-405f8ae7-7abe-4975-944d-602c106a7230 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:57.399973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-405f8ae7-7abe-4975-944d-602c106a7230 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Nov 08 17:43:57.400517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 472/969] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:43:57.566863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-849f6abf-b167-4456-ad54-654d429e27c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:57.567861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-849f6abf-b167-4456-ad54-654d429e27c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:57.574902 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-849f6abf-b167-4456-ad54-654d429e27c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:57.575354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-849f6abf-b167-4456-ad54-654d429e27c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:57.576125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-849f6abf-b167-4456-ad54-654d429e27c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:57.576561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-849f6abf-b167-4456-ad54-654d429e27c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:57.606914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-849f6abf-b167-4456-ad54-654d429e27c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044298 Nov 08 17:43:57.607465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 498/970] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:57.790448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f3b0aebe-69e4-4eee-9bbc-41726fa298b5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f9d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:57.835000 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f3b0aebe-69e4-4eee-9bbc-41726fa298b5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047855 Nov 08 17:43:57.835555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 473/971] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:57 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:58.122977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-479729c1-f32b-4aaf-a4ef-fbc2d39daf2b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:58.123935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-479729c1-f32b-4aaf-a4ef-fbc2d39daf2b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:58.131100 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-479729c1-f32b-4aaf-a4ef-fbc2d39daf2b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:58.131537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-479729c1-f32b-4aaf-a4ef-fbc2d39daf2b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:58.132299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-479729c1-f32b-4aaf-a4ef-fbc2d39daf2b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:58.132725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-479729c1-f32b-4aaf-a4ef-fbc2d39daf2b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:58.213306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-479729c1-f32b-4aaf-a4ef-fbc2d39daf2b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 32909 microversion: 2.1 time: 0.093736 Nov 08 17:43:58.214206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 499/972] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:58 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 32909 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:58.413011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5a677c5a-af91-4e8d-b010-2131efb02dc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:58.413837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5a677c5a-af91-4e8d-b010-2131efb02dc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:58.419761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a677c5a-af91-4e8d-b010-2131efb02dc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:58.420203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a677c5a-af91-4e8d-b010-2131efb02dc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:58.420969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a677c5a-af91-4e8d-b010-2131efb02dc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:58.421398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a677c5a-af91-4e8d-b010-2131efb02dc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:58.451593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5a677c5a-af91-4e8d-b010-2131efb02dc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Nov 08 17:43:58.452158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 474/973] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:58.619981 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a5e8e1bd-0c38-4af0-ab33-3397edbd226c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:58.620991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a5e8e1bd-0c38-4af0-ab33-3397edbd226c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:58.629864 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a5e8e1bd-0c38-4af0-ab33-3397edbd226c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:58.630578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a5e8e1bd-0c38-4af0-ab33-3397edbd226c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:58.631227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a5e8e1bd-0c38-4af0-ab33-3397edbd226c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:58.631652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a5e8e1bd-0c38-4af0-ab33-3397edbd226c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:58.664339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a5e8e1bd-0c38-4af0-ab33-3397edbd226c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049294 Nov 08 17:43:58.664813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 500/974] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:58.852432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-638d7901-4ea6-4538-8246-703abc17196b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd9d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:58.902332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-638d7901-4ea6-4538-8246-703abc17196b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053588 Nov 08 17:43:58.902930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 475/975] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:58 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:59.274608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3fa5b0c4-6ddb-4e11-85c5-3c68714cddd3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:43:59.276179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3fa5b0c4-6ddb-4e11-85c5-3c68714cddd3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:59.281985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3fa5b0c4-6ddb-4e11-85c5-3c68714cddd3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:59.282427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3fa5b0c4-6ddb-4e11-85c5-3c68714cddd3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:59.283223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3fa5b0c4-6ddb-4e11-85c5-3c68714cddd3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:59.283654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3fa5b0c4-6ddb-4e11-85c5-3c68714cddd3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:59.360198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3fa5b0c4-6ddb-4e11-85c5-3c68714cddd3 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 33784 microversion: 2.1 time: 0.138821 Nov 08 17:43:59.360799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 501/976] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:43:59 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 33784 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:59.464270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1311a229-51ef-4cc5-9201-848712c4c97d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:59.465168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1311a229-51ef-4cc5-9201-848712c4c97d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:59.471477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1311a229-51ef-4cc5-9201-848712c4c97d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:59.471913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1311a229-51ef-4cc5-9201-848712c4c97d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:59.472675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1311a229-51ef-4cc5-9201-848712c4c97d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:59.473642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1311a229-51ef-4cc5-9201-848712c4c97d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:59.501961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1311a229-51ef-4cc5-9201-848712c4c97d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 Nov 08 17:43:59.502441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 476/977] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:43:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:43:59.677936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ee092103-632f-4981-bb54-4475666351a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:59.678956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ee092103-632f-4981-bb54-4475666351a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:43:59.685923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee092103-632f-4981-bb54-4475666351a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:59.686375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee092103-632f-4981-bb54-4475666351a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:59.687162 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee092103-632f-4981-bb54-4475666351a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:43:59.687594 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee092103-632f-4981-bb54-4475666351a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:43:59.716601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ee092103-632f-4981-bb54-4475666351a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042840 Nov 08 17:43:59.717161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 502/978] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:43:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:43:59.915137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cddc48de-d0b7-4f52-a75d-9725639fafcc tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd9d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:43:59.962254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cddc48de-d0b7-4f52-a75d-9725639fafcc tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049959 Nov 08 17:43:59.962254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 477/979] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:43:59 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:00.372767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-831e1bc2-3040-4b4a-af9e-c27fa83f8cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:44:00.373678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-831e1bc2-3040-4b4a-af9e-c27fa83f8cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:00.381413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-831e1bc2-3040-4b4a-af9e-c27fa83f8cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:00.381867 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-831e1bc2-3040-4b4a-af9e-c27fa83f8cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:00.382689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-831e1bc2-3040-4b4a-af9e-c27fa83f8cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:00.383121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-831e1bc2-3040-4b4a-af9e-c27fa83f8cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:00.467852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-831e1bc2-3040-4b4a-af9e-c27fa83f8cc7 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 34941 microversion: 2.1 time: 0.098135 Nov 08 17:44:00.468415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 503/980] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:44:00 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 34941 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:00.513352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e9c6b4cd-f43d-4f4d-a569-9493a112199c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:00.514301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e9c6b4cd-f43d-4f4d-a569-9493a112199c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:00.521041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e9c6b4cd-f43d-4f4d-a569-9493a112199c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:00.521486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e9c6b4cd-f43d-4f4d-a569-9493a112199c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:00.522256 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e9c6b4cd-f43d-4f4d-a569-9493a112199c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:00.522710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e9c6b4cd-f43d-4f4d-a569-9493a112199c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:00.549921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e9c6b4cd-f43d-4f4d-a569-9493a112199c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040755 Nov 08 17:44:00.550483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 478/981] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:00.729220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ba5d0811-3a4f-4082-9c2c-3d35a1e2a0cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:00.730113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ba5d0811-3a4f-4082-9c2c-3d35a1e2a0cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:00.736926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba5d0811-3a4f-4082-9c2c-3d35a1e2a0cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:00.737363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba5d0811-3a4f-4082-9c2c-3d35a1e2a0cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:00.738123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba5d0811-3a4f-4082-9c2c-3d35a1e2a0cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:00.738642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba5d0811-3a4f-4082-9c2c-3d35a1e2a0cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:00.768196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ba5d0811-3a4f-4082-9c2c-3d35a1e2a0cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043149 Nov 08 17:44:00.768728 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 504/982] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:00.972755 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5619c4ba-4634-4fae-8c9a-1ff485919fa0 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2a1280>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:01.019764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5619c4ba-4634-4fae-8c9a-1ff485919fa0 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050506 Nov 08 17:44:01.020506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 479/983] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:00 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:01.479308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2f15c152-05d2-4833-b8dd-dd6ac677079a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:44:01.480248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2f15c152-05d2-4833-b8dd-dd6ac677079a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:01.486416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f15c152-05d2-4833-b8dd-dd6ac677079a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:01.486895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f15c152-05d2-4833-b8dd-dd6ac677079a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:01.492544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f15c152-05d2-4833-b8dd-dd6ac677079a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:01.492544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f15c152-05d2-4833-b8dd-dd6ac677079a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:01.562247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a4eb0d9a-8dfe-437d-8746-d27db5906bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:01.563161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a4eb0d9a-8dfe-437d-8746-d27db5906bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:01.570264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4eb0d9a-8dfe-437d-8746-d27db5906bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:01.570733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4eb0d9a-8dfe-437d-8746-d27db5906bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:01.571510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4eb0d9a-8dfe-437d-8746-d27db5906bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:01.571941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4eb0d9a-8dfe-437d-8746-d27db5906bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:01.574136 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2f15c152-05d2-4833-b8dd-dd6ac677079a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 36162 microversion: 2.1 time: 0.098302 Nov 08 17:44:01.575513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 505/984] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:44:01 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 36162 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:01.600878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a4eb0d9a-8dfe-437d-8746-d27db5906bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042789 Nov 08 17:44:01.601425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 480/985] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:01.780141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f89f067b-adf1-4630-b98d-9b0bdf0f47cf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:01.781051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f89f067b-adf1-4630-b98d-9b0bdf0f47cf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:01.787962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f89f067b-adf1-4630-b98d-9b0bdf0f47cf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:01.788406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f89f067b-adf1-4630-b98d-9b0bdf0f47cf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:01.789173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f89f067b-adf1-4630-b98d-9b0bdf0f47cf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:01.789604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f89f067b-adf1-4630-b98d-9b0bdf0f47cf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:01.819105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f89f067b-adf1-4630-b98d-9b0bdf0f47cf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043138 Nov 08 17:44:01.819644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 506/986] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:02.032097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f00c6cc3-44a7-4d78-8ddf-d0fff0e148e3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37c3a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:02.077437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f00c6cc3-44a7-4d78-8ddf-d0fff0e148e3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048969 Nov 08 17:44:02.077996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 481/987] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:02 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:02.587446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2966d9b5-fbb7-4597-b061-32219b5b7b10 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:44:02.588383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2966d9b5-fbb7-4597-b061-32219b5b7b10 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:02.594732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2966d9b5-fbb7-4597-b061-32219b5b7b10 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:02.595185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2966d9b5-fbb7-4597-b061-32219b5b7b10 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:02.595957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2966d9b5-fbb7-4597-b061-32219b5b7b10 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:02.596395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2966d9b5-fbb7-4597-b061-32219b5b7b10 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:02.612388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3651c887-8bef-474c-9434-32f17fda5d4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:02.613371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3651c887-8bef-474c-9434-32f17fda5d4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:02.620613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3651c887-8bef-474c-9434-32f17fda5d4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:02.621060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3651c887-8bef-474c-9434-32f17fda5d4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:02.621838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3651c887-8bef-474c-9434-32f17fda5d4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:02.622274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3651c887-8bef-474c-9434-32f17fda5d4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:02.650591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3651c887-8bef-474c-9434-32f17fda5d4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Nov 08 17:44:02.651154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 482/988] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:02.672567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2966d9b5-fbb7-4597-b061-32219b5b7b10 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 37761 microversion: 2.1 time: 0.090036 Nov 08 17:44:02.673223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 507/989] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:44:02 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 37761 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:02.829801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d09b6cab-efe1-4a28-a004-21980db54e2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:02.830685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d09b6cab-efe1-4a28-a004-21980db54e2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:02.836955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d09b6cab-efe1-4a28-a004-21980db54e2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:02.837945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d09b6cab-efe1-4a28-a004-21980db54e2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:02.838223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d09b6cab-efe1-4a28-a004-21980db54e2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:02.838690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d09b6cab-efe1-4a28-a004-21980db54e2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:02.869060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d09b6cab-efe1-4a28-a004-21980db54e2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043174 Nov 08 17:44:02.869615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 483/990] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:03.090003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8365ab05-7d9b-412b-88dc-8b873a6c954d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec335e50>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:03.185588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8365ab05-7d9b-412b-88dc-8b873a6c954d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.099550 Nov 08 17:44:03.186184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 508/991] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:03 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:03.661672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cb9ec396-4e47-462e-8b8b-73ac074f1e43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:03.662596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cb9ec396-4e47-462e-8b8b-73ac074f1e43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:03.668719 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb9ec396-4e47-462e-8b8b-73ac074f1e43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:03.669168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb9ec396-4e47-462e-8b8b-73ac074f1e43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:03.669929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb9ec396-4e47-462e-8b8b-73ac074f1e43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:03.670359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb9ec396-4e47-462e-8b8b-73ac074f1e43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:03.685008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-500aaeae-98a6-4c3c-89f5-3606ee17e8b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:44:03.686057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-500aaeae-98a6-4c3c-89f5-3606ee17e8b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:03.692143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-500aaeae-98a6-4c3c-89f5-3606ee17e8b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:03.692583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-500aaeae-98a6-4c3c-89f5-3606ee17e8b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:03.693351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-500aaeae-98a6-4c3c-89f5-3606ee17e8b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:03.693777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-500aaeae-98a6-4c3c-89f5-3606ee17e8b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:03.698670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cb9ec396-4e47-462e-8b8b-73ac074f1e43 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041354 Nov 08 17:44:03.699239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 484/992] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:03.769376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-500aaeae-98a6-4c3c-89f5-3606ee17e8b0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 38187 microversion: 2.1 time: 0.088221 Nov 08 17:44:03.770844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 509/993] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:44:03 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 38187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:44:03.881023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3283039b-7c6f-4160-afeb-ab3476f94704 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:03.881968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3283039b-7c6f-4160-afeb-ab3476f94704 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:03.887874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3283039b-7c6f-4160-afeb-ab3476f94704 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:03.888323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3283039b-7c6f-4160-afeb-ab3476f94704 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:03.889092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3283039b-7c6f-4160-afeb-ab3476f94704 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:03.889527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3283039b-7c6f-4160-afeb-ab3476f94704 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:03.918918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3283039b-7c6f-4160-afeb-ab3476f94704 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042506 Nov 08 17:44:03.919399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 485/994] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:04.198170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-942f6d38-5994-4ce3-910a-e8f8e88806e3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec28d700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:04.244308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-942f6d38-5994-4ce3-910a-e8f8e88806e3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050158 Nov 08 17:44:04.244864 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 510/995] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:04 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:04.709105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-938da18d-2bf9-4e4d-9845-a123e949fb50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:04.709993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-938da18d-2bf9-4e4d-9845-a123e949fb50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:04.716269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-938da18d-2bf9-4e4d-9845-a123e949fb50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:04.716708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-938da18d-2bf9-4e4d-9845-a123e949fb50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:04.717459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-938da18d-2bf9-4e4d-9845-a123e949fb50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:04.717883 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-938da18d-2bf9-4e4d-9845-a123e949fb50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:04.748129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-938da18d-2bf9-4e4d-9845-a123e949fb50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042822 Nov 08 17:44:04.748601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 486/996] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:04.781889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1b6c5f9e-228a-4dc2-b9ed-42c5d879ccfe tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:44:04.782922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1b6c5f9e-228a-4dc2-b9ed-42c5d879ccfe tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:04.789709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b6c5f9e-228a-4dc2-b9ed-42c5d879ccfe tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:04.790153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b6c5f9e-228a-4dc2-b9ed-42c5d879ccfe tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:04.790982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b6c5f9e-228a-4dc2-b9ed-42c5d879ccfe tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:04.791419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1b6c5f9e-228a-4dc2-b9ed-42c5d879ccfe tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:04.855168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1b6c5f9e-228a-4dc2-b9ed-42c5d879ccfe tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 38187 microversion: 2.1 time: 0.077191 Nov 08 17:44:04.855783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 511/997] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:44:04 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 38187 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:04.930429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0a1dde1f-e2b7-47b1-a3df-c8ccaef9f3b5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:04.931383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0a1dde1f-e2b7-47b1-a3df-c8ccaef9f3b5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:04.937384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a1dde1f-e2b7-47b1-a3df-c8ccaef9f3b5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:04.937835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a1dde1f-e2b7-47b1-a3df-c8ccaef9f3b5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:04.938634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a1dde1f-e2b7-47b1-a3df-c8ccaef9f3b5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:04.939067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a1dde1f-e2b7-47b1-a3df-c8ccaef9f3b5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:04.967603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0a1dde1f-e2b7-47b1-a3df-c8ccaef9f3b5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041216 Nov 08 17:44:04.968183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 487/998] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:05.257723 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0f55f711-ddca-4452-b7e8-0fd7371e7b9b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c5c10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:05.303356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0f55f711-ddca-4452-b7e8-0fd7371e7b9b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050272 Nov 08 17:44:05.303919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 512/999] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:05 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:05.759562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9e036d94-4a9e-42aa-804c-c080f74dc7de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:05.760457 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9e036d94-4a9e-42aa-804c-c080f74dc7de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:05.766630 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9e036d94-4a9e-42aa-804c-c080f74dc7de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:05.767073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9e036d94-4a9e-42aa-804c-c080f74dc7de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:05.767834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9e036d94-4a9e-42aa-804c-c080f74dc7de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:05.768263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9e036d94-4a9e-42aa-804c-c080f74dc7de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:05.797627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9e036d94-4a9e-42aa-804c-c080f74dc7de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Nov 08 17:44:05.798341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 488/1000] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:05.868402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-84f8f16b-e1ec-41ef-8df2-79de7cc14e08 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:44:05.869417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-84f8f16b-e1ec-41ef-8df2-79de7cc14e08 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:05.875603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84f8f16b-e1ec-41ef-8df2-79de7cc14e08 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:05.876043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84f8f16b-e1ec-41ef-8df2-79de7cc14e08 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:05.876796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84f8f16b-e1ec-41ef-8df2-79de7cc14e08 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:05.877221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-84f8f16b-e1ec-41ef-8df2-79de7cc14e08 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:05.938302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-84f8f16b-e1ec-41ef-8df2-79de7cc14e08 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 38187 microversion: 2.1 time: 0.075177 Nov 08 17:44:05.938958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 513/1001] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:44:05 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 38187 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:05.979613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fe70fc16-aa7b-4380-a28f-90392000bf9a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:05.980504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fe70fc16-aa7b-4380-a28f-90392000bf9a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:05.986303 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe70fc16-aa7b-4380-a28f-90392000bf9a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:05.986776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe70fc16-aa7b-4380-a28f-90392000bf9a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:05.987544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe70fc16-aa7b-4380-a28f-90392000bf9a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:05.988014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe70fc16-aa7b-4380-a28f-90392000bf9a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:06.017405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fe70fc16-aa7b-4380-a28f-90392000bf9a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041496 Nov 08 17:44:06.017884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 489/1002] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:06.315274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-abdbaced-6422-49c5-a3c9-8934c53dc8f7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24a9d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:06.361318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-abdbaced-6422-49c5-a3c9-8934c53dc8f7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050035 Nov 08 17:44:06.361944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 514/1003] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:06 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:06.809526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-68e5edde-54bf-48ef-b78e-ef9f6fd21787 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:06.810488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-68e5edde-54bf-48ef-b78e-ef9f6fd21787 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:06.816745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68e5edde-54bf-48ef-b78e-ef9f6fd21787 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:06.817199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68e5edde-54bf-48ef-b78e-ef9f6fd21787 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:06.818674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68e5edde-54bf-48ef-b78e-ef9f6fd21787 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:06.819120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68e5edde-54bf-48ef-b78e-ef9f6fd21787 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:06.847964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-68e5edde-54bf-48ef-b78e-ef9f6fd21787 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 Nov 08 17:44:06.848552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 490/1004] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:06.951999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-04fb03eb-77e1-43ef-97ea-2c7e64acaa62 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:44:06.953048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-04fb03eb-77e1-43ef-97ea-2c7e64acaa62 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:06.959796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04fb03eb-77e1-43ef-97ea-2c7e64acaa62 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:06.960242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04fb03eb-77e1-43ef-97ea-2c7e64acaa62 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:06.961012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04fb03eb-77e1-43ef-97ea-2c7e64acaa62 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:06.961447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04fb03eb-77e1-43ef-97ea-2c7e64acaa62 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:07.029459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aaa95bbd-f155-4f0c-8e6d-f1163b600eba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:07.030415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aaa95bbd-f155-4f0c-8e6d-f1163b600eba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:07.034060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-04fb03eb-77e1-43ef-97ea-2c7e64acaa62 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 38207 microversion: 2.1 time: 0.086941 Nov 08 17:44:07.035009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 515/1005] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:44:06 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 38207 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:07.036656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aaa95bbd-f155-4f0c-8e6d-f1163b600eba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:07.037210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aaa95bbd-f155-4f0c-8e6d-f1163b600eba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:07.038006 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aaa95bbd-f155-4f0c-8e6d-f1163b600eba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:07.038448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aaa95bbd-f155-4f0c-8e6d-f1163b600eba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:07.067120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aaa95bbd-f155-4f0c-8e6d-f1163b600eba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042264 Nov 08 17:44:07.068110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 491/1006] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:44:07.373708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-61918e81-2e0d-4e79-b1fd-bc5f197fcdc4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373f70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:07.419383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-61918e81-2e0d-4e79-b1fd-bc5f197fcdc4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049497 Nov 08 17:44:07.419967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 516/1007] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:07 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:07.859661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fa15c99f-badd-41bb-8073-1130a68aa5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:07.860499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fa15c99f-badd-41bb-8073-1130a68aa5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:07.866529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fa15c99f-badd-41bb-8073-1130a68aa5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:07.867226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fa15c99f-badd-41bb-8073-1130a68aa5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:07.867985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fa15c99f-badd-41bb-8073-1130a68aa5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:07.868414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fa15c99f-badd-41bb-8073-1130a68aa5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:07.896412 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fa15c99f-badd-41bb-8073-1130a68aa5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040031 Nov 08 17:44:07.896954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 492/1008] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:08.046541 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a664b5c8-84b4-4256-858c-80394cb3b45e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:44:08.047659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a664b5c8-84b4-4256-858c-80394cb3b45e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:08.053975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a664b5c8-84b4-4256-858c-80394cb3b45e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:08.054415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a664b5c8-84b4-4256-858c-80394cb3b45e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:08.055205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a664b5c8-84b4-4256-858c-80394cb3b45e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:08.055633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a664b5c8-84b4-4256-858c-80394cb3b45e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:08.079311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5186cf5e-e3d9-4955-b1b1-656f8bd87049 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:08.080234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5186cf5e-e3d9-4955-b1b1-656f8bd87049 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:08.087086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5186cf5e-e3d9-4955-b1b1-656f8bd87049 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:08.087530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5186cf5e-e3d9-4955-b1b1-656f8bd87049 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:08.088296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5186cf5e-e3d9-4955-b1b1-656f8bd87049 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:08.088758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5186cf5e-e3d9-4955-b1b1-656f8bd87049 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:08.117368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5186cf5e-e3d9-4955-b1b1-656f8bd87049 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041555 Nov 08 17:44:08.117930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 493/1009] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:44:08.125550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a664b5c8-84b4-4256-858c-80394cb3b45e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action" status: 200 len: 38316 microversion: 2.1 time: 0.083519 Nov 08 17:44:08.126223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 517/1010] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:44:08 2021] POST /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/action => generated 38316 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:08.135561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-39d2b6e1-b132-4709-b9b6-cac1cc520ca0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:08.136076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-39d2b6e1-b132-4709-b9b6-cac1cc520ca0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:08.141725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39d2b6e1-b132-4709-b9b6-cac1cc520ca0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:08.142166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39d2b6e1-b132-4709-b9b6-cac1cc520ca0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:08.142961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39d2b6e1-b132-4709-b9b6-cac1cc520ca0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:08.143394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39d2b6e1-b132-4709-b9b6-cac1cc520ca0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:08.166846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-39d2b6e1-b132-4709-b9b6-cac1cc520ca0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/ips" status: 200 len: 146 microversion: 2.1 time: 0.034858 Nov 08 17:44:08.167403 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 494/1011] 10.222.0.18 () {58 vars in 1247 bytes} [Mon Nov 8 17:44:08 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:08.432093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6926aca1-661c-4050-b49e-a0cecb2d98eb tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c280>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:08.654169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6926aca1-661c-4050-b49e-a0cecb2d98eb tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.226069 Nov 08 17:44:08.654782 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 518/1012] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:08 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:08.907942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-79329d25-71d9-4714-8fdf-7d2dc6b65480 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:08.908847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-79329d25-71d9-4714-8fdf-7d2dc6b65480 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:08.914609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79329d25-71d9-4714-8fdf-7d2dc6b65480 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:08.915058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79329d25-71d9-4714-8fdf-7d2dc6b65480 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:08.915850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79329d25-71d9-4714-8fdf-7d2dc6b65480 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:08.916281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79329d25-71d9-4714-8fdf-7d2dc6b65480 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:08.947323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-79329d25-71d9-4714-8fdf-7d2dc6b65480 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Nov 08 17:44:08.947780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 495/1013] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:09.129273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-244c6108-fd5f-4e15-bc48-0c1e70b28746 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:09.130320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-244c6108-fd5f-4e15-bc48-0c1e70b28746 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:09.136359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-244c6108-fd5f-4e15-bc48-0c1e70b28746 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:09.136801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-244c6108-fd5f-4e15-bc48-0c1e70b28746 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:09.137560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-244c6108-fd5f-4e15-bc48-0c1e70b28746 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:09.137986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-244c6108-fd5f-4e15-bc48-0c1e70b28746 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:09.166186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-244c6108-fd5f-4e15-bc48-0c1e70b28746 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041136 Nov 08 17:44:09.166763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 519/1014] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:09.670847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c67af47d-e9e3-43b4-879e-665e7162d42f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec390430>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:09.716061 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c67af47d-e9e3-43b4-879e-665e7162d42f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048757 Nov 08 17:44:09.716614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 496/1015] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:09 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:09.958743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-733861d1-4cb3-4c04-9b0e-19ae4a2fa3a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:09.959581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-733861d1-4cb3-4c04-9b0e-19ae4a2fa3a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:09.965773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-733861d1-4cb3-4c04-9b0e-19ae4a2fa3a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:09.966216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-733861d1-4cb3-4c04-9b0e-19ae4a2fa3a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:09.971836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-733861d1-4cb3-4c04-9b0e-19ae4a2fa3a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:09.971836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-733861d1-4cb3-4c04-9b0e-19ae4a2fa3a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:09.996941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-733861d1-4cb3-4c04-9b0e-19ae4a2fa3a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Nov 08 17:44:09.997508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 520/1016] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:10.177124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-18e77c07-ae0a-4d06-830f-38f6292af925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:10.178016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-18e77c07-ae0a-4d06-830f-38f6292af925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:10.183897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18e77c07-ae0a-4d06-830f-38f6292af925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:10.184335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18e77c07-ae0a-4d06-830f-38f6292af925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:10.185089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18e77c07-ae0a-4d06-830f-38f6292af925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:10.185512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18e77c07-ae0a-4d06-830f-38f6292af925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:10.215472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-18e77c07-ae0a-4d06-830f-38f6292af925 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042137 Nov 08 17:44:10.215938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 497/1017] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:10.728176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e7375878-bbd8-4b2a-befc-9eaebf597a35 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c18b0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:10.773085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e7375878-bbd8-4b2a-befc-9eaebf597a35 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048532 Nov 08 17:44:10.773649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 521/1018] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:10 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:11.009519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ae9784b9-9a5d-4dd8-95d9-c6a9b7acf73f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:11.010428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ae9784b9-9a5d-4dd8-95d9-c6a9b7acf73f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:11.016675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae9784b9-9a5d-4dd8-95d9-c6a9b7acf73f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:11.017127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae9784b9-9a5d-4dd8-95d9-c6a9b7acf73f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:11.017915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae9784b9-9a5d-4dd8-95d9-c6a9b7acf73f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:11.018356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae9784b9-9a5d-4dd8-95d9-c6a9b7acf73f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:11.046741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ae9784b9-9a5d-4dd8-95d9-c6a9b7acf73f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042115 Nov 08 17:44:11.047292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 498/1019] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:11.228615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c4e4ec31-49a3-42f1-a9a8-5aa89d2625df tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:11.229531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c4e4ec31-49a3-42f1-a9a8-5aa89d2625df tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:11.236227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4e4ec31-49a3-42f1-a9a8-5aa89d2625df tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:11.236693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4e4ec31-49a3-42f1-a9a8-5aa89d2625df tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:11.237462 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4e4ec31-49a3-42f1-a9a8-5aa89d2625df tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:11.237898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4e4ec31-49a3-42f1-a9a8-5aa89d2625df tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:11.267179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c4e4ec31-49a3-42f1-a9a8-5aa89d2625df tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044296 Nov 08 17:44:11.267657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 522/1020] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:11.784376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b97577dd-cb4a-4da2-9597-ca87f90c7b04 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:11.829313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b97577dd-cb4a-4da2-9597-ca87f90c7b04 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048430 Nov 08 17:44:11.829879 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 499/1021] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:11 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:12.058284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-607a66f4-d867-4eaa-9f61-0354c5218429 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:12.059135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-607a66f4-d867-4eaa-9f61-0354c5218429 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:12.065274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-607a66f4-d867-4eaa-9f61-0354c5218429 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:12.065711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-607a66f4-d867-4eaa-9f61-0354c5218429 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:12.066526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-607a66f4-d867-4eaa-9f61-0354c5218429 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:12.066955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-607a66f4-d867-4eaa-9f61-0354c5218429 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:12.094173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-607a66f4-d867-4eaa-9f61-0354c5218429 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039675 Nov 08 17:44:12.094741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 523/1022] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:12.279205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-288e9634-9b4f-4994-a12c-4bfd2f3784ec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:12.280097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-288e9634-9b4f-4994-a12c-4bfd2f3784ec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:12.287173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-288e9634-9b4f-4994-a12c-4bfd2f3784ec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:12.287618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-288e9634-9b4f-4994-a12c-4bfd2f3784ec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:12.288380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-288e9634-9b4f-4994-a12c-4bfd2f3784ec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:12.288809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-288e9634-9b4f-4994-a12c-4bfd2f3784ec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:12.317017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-288e9634-9b4f-4994-a12c-4bfd2f3784ec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042048 Nov 08 17:44:12.317534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 500/1023] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:12.840831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0a5b1264-4263-4765-b72d-4b98fc1c229d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e5430>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:12.885707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0a5b1264-4263-4765-b72d-4b98fc1c229d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048407 Nov 08 17:44:12.886275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 524/1024] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:13.105416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-81500bcd-d496-4ae4-b662-54b07c078779 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:13.106317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-81500bcd-d496-4ae4-b662-54b07c078779 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:13.111989 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81500bcd-d496-4ae4-b662-54b07c078779 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:13.112434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81500bcd-d496-4ae4-b662-54b07c078779 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:13.113200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81500bcd-d496-4ae4-b662-54b07c078779 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:13.113631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81500bcd-d496-4ae4-b662-54b07c078779 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:13.143392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-81500bcd-d496-4ae4-b662-54b07c078779 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041665 Nov 08 17:44:13.143954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 501/1025] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:13.329312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f325d6a2-1aa9-488f-9f49-83f5bd4299e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:13.330199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f325d6a2-1aa9-488f-9f49-83f5bd4299e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:13.336820 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f325d6a2-1aa9-488f-9f49-83f5bd4299e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:13.337261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f325d6a2-1aa9-488f-9f49-83f5bd4299e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:13.338014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f325d6a2-1aa9-488f-9f49-83f5bd4299e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:13.338438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f325d6a2-1aa9-488f-9f49-83f5bd4299e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:13.367598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f325d6a2-1aa9-488f-9f49-83f5bd4299e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042505 Nov 08 17:44:13.368138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 525/1026] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:13.898398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8d8601bb-9913-4fb6-a8eb-9e4dd38a0ed9 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd9d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:13.943645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8d8601bb-9913-4fb6-a8eb-9e4dd38a0ed9 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049441 Nov 08 17:44:13.944214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 502/1027] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:13 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:14.154570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-281885cf-f3c2-4b36-8520-cc5104377b36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:14.155472 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-281885cf-f3c2-4b36-8520-cc5104377b36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:14.161775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-281885cf-f3c2-4b36-8520-cc5104377b36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:14.162486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-281885cf-f3c2-4b36-8520-cc5104377b36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:14.163276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-281885cf-f3c2-4b36-8520-cc5104377b36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:14.163700 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-281885cf-f3c2-4b36-8520-cc5104377b36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:14.191471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-281885cf-f3c2-4b36-8520-cc5104377b36 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040658 Nov 08 17:44:14.192017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 526/1028] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:14.379088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-422de8c6-477e-4112-9eff-0d03658086af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:14.380512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-422de8c6-477e-4112-9eff-0d03658086af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:14.387117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-422de8c6-477e-4112-9eff-0d03658086af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:14.387562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-422de8c6-477e-4112-9eff-0d03658086af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:14.388333 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-422de8c6-477e-4112-9eff-0d03658086af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:14.388763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-422de8c6-477e-4112-9eff-0d03658086af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:14.416525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-422de8c6-477e-4112-9eff-0d03658086af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041132 Nov 08 17:44:14.416988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 503/1029] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:14.954812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f0041fbf-63d4-4372-862f-63d645150896 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e20d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:15.001081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f0041fbf-63d4-4372-862f-63d645150896 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049897 Nov 08 17:44:15.001652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 527/1030] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:14 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:15.202713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7ee5142d-9e52-4bea-8afb-212cd18ec174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:15.203610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7ee5142d-9e52-4bea-8afb-212cd18ec174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:15.209788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ee5142d-9e52-4bea-8afb-212cd18ec174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:15.210165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ee5142d-9e52-4bea-8afb-212cd18ec174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:15.210963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ee5142d-9e52-4bea-8afb-212cd18ec174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:15.211390 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ee5142d-9e52-4bea-8afb-212cd18ec174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:15.240509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7ee5142d-9e52-4bea-8afb-212cd18ec174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041341 Nov 08 17:44:15.241054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 504/1031] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:15.428451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d74cbaab-c8b3-4f13-9370-310a5e3e1236 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:15.429346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d74cbaab-c8b3-4f13-9370-310a5e3e1236 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:15.435847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d74cbaab-c8b3-4f13-9370-310a5e3e1236 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:15.436314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d74cbaab-c8b3-4f13-9370-310a5e3e1236 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:15.437071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d74cbaab-c8b3-4f13-9370-310a5e3e1236 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:15.437497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d74cbaab-c8b3-4f13-9370-310a5e3e1236 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:15.465379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d74cbaab-c8b3-4f13-9370-310a5e3e1236 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040800 Nov 08 17:44:15.465851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 528/1032] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:16.012936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c56a06b1-7469-488e-b93b-56b6f3f7e2f0 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3840d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:16.059499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c56a06b1-7469-488e-b93b-56b6f3f7e2f0 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050168 Nov 08 17:44:16.060079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 505/1033] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:16 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:16.251163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-027cb97d-4ac7-4610-a4cd-23df0b909557 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:16.252062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-027cb97d-4ac7-4610-a4cd-23df0b909557 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:16.258887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-027cb97d-4ac7-4610-a4cd-23df0b909557 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:16.259332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-027cb97d-4ac7-4610-a4cd-23df0b909557 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:16.260096 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-027cb97d-4ac7-4610-a4cd-23df0b909557 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:16.260520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-027cb97d-4ac7-4610-a4cd-23df0b909557 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:16.288258 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-027cb97d-4ac7-4610-a4cd-23df0b909557 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 Nov 08 17:44:16.288785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 529/1034] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:16.477570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fd3ee357-f258-4b3d-82a7-658a21d2eaeb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:16.478107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fd3ee357-f258-4b3d-82a7-658a21d2eaeb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:16.484850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd3ee357-f258-4b3d-82a7-658a21d2eaeb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:16.485293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd3ee357-f258-4b3d-82a7-658a21d2eaeb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:16.486062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd3ee357-f258-4b3d-82a7-658a21d2eaeb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:16.486519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd3ee357-f258-4b3d-82a7-658a21d2eaeb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:16.515127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fd3ee357-f258-4b3d-82a7-658a21d2eaeb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042162 Nov 08 17:44:16.515617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 506/1035] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:17.072669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8c09f260-f710-4e16-ad81-35ae369d3193 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec6f4ee0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:17.119145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8c09f260-f710-4e16-ad81-35ae369d3193 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050901 Nov 08 17:44:17.119734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 530/1036] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:17 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:17.299073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5cfba473-2e88-45df-99dd-845dceef6ca2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:17.300007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5cfba473-2e88-45df-99dd-845dceef6ca2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:17.306898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5cfba473-2e88-45df-99dd-845dceef6ca2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:17.311169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5cfba473-2e88-45df-99dd-845dceef6ca2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:17.311169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5cfba473-2e88-45df-99dd-845dceef6ca2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:17.311169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5cfba473-2e88-45df-99dd-845dceef6ca2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:17.338297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5cfba473-2e88-45df-99dd-845dceef6ca2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Nov 08 17:44:17.338948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 507/1037] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:17.526329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8aef3681-92e3-4ac0-b575-4789278e9b9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:17.527183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8aef3681-92e3-4ac0-b575-4789278e9b9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:17.533692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8aef3681-92e3-4ac0-b575-4789278e9b9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:17.534137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8aef3681-92e3-4ac0-b575-4789278e9b9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:17.534932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8aef3681-92e3-4ac0-b575-4789278e9b9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:17.535394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8aef3681-92e3-4ac0-b575-4789278e9b9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:17.563906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8aef3681-92e3-4ac0-b575-4789278e9b9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041961 Nov 08 17:44:17.564443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 531/1038] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:18.131453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c86cfb21-ccfe-425a-b362-b7984aefcb0d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec268940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:18.176149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c86cfb21-ccfe-425a-b362-b7984aefcb0d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048284 Nov 08 17:44:18.176746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 508/1039] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:18 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:18.350270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-860acf48-616d-4c24-97c5-3ee1d9f11990 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:18.351200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-860acf48-616d-4c24-97c5-3ee1d9f11990 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:18.357008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-860acf48-616d-4c24-97c5-3ee1d9f11990 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:18.357451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-860acf48-616d-4c24-97c5-3ee1d9f11990 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:18.358313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-860acf48-616d-4c24-97c5-3ee1d9f11990 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:18.358773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-860acf48-616d-4c24-97c5-3ee1d9f11990 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:18.386926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-860acf48-616d-4c24-97c5-3ee1d9f11990 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Nov 08 17:44:18.387459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 532/1040] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:18.575371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-84785285-6788-4200-a36d-15f3e00e6ef1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:18.576211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-84785285-6788-4200-a36d-15f3e00e6ef1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:18.582057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-84785285-6788-4200-a36d-15f3e00e6ef1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:18.582529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-84785285-6788-4200-a36d-15f3e00e6ef1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:18.583886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-84785285-6788-4200-a36d-15f3e00e6ef1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:18.584317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-84785285-6788-4200-a36d-15f3e00e6ef1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:18.612847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-84785285-6788-4200-a36d-15f3e00e6ef1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041265 Nov 08 17:44:18.613395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 509/1041] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:19.188974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bdf628a2-8beb-43ff-8f19-ba9b15bbd74c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e20d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:19.234069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bdf628a2-8beb-43ff-8f19-ba9b15bbd74c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048640 Nov 08 17:44:19.239019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 533/1042] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:19 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:19.398164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6e4802ea-49fd-4055-a6cc-7a2218768b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:19.399106 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6e4802ea-49fd-4055-a6cc-7a2218768b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:19.405296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e4802ea-49fd-4055-a6cc-7a2218768b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:19.405743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e4802ea-49fd-4055-a6cc-7a2218768b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:19.406537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e4802ea-49fd-4055-a6cc-7a2218768b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:19.406974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e4802ea-49fd-4055-a6cc-7a2218768b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:19.434935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6e4802ea-49fd-4055-a6cc-7a2218768b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040579 Nov 08 17:44:19.435484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 510/1043] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:19.624794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fbcd5c5a-a2c4-4cd5-926d-e9aebba60c1a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:19.625702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fbcd5c5a-a2c4-4cd5-926d-e9aebba60c1a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:19.632431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbcd5c5a-a2c4-4cd5-926d-e9aebba60c1a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:19.632878 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbcd5c5a-a2c4-4cd5-926d-e9aebba60c1a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:19.633651 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbcd5c5a-a2c4-4cd5-926d-e9aebba60c1a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:19.634084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbcd5c5a-a2c4-4cd5-926d-e9aebba60c1a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:19.662152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fbcd5c5a-a2c4-4cd5-926d-e9aebba60c1a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040577 Nov 08 17:44:19.662827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 534/1044] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:20.246644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-84d71e40-d295-40ca-be78-3a6c7d0c5347 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37ca60>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:20.291425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-84d71e40-d295-40ca-be78-3a6c7d0c5347 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048469 Nov 08 17:44:20.291992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 511/1045] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:20 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:20.447157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-58acc1c0-9034-48f2-a9b0-faca9de55f87 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:20.448061 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-58acc1c0-9034-48f2-a9b0-faca9de55f87 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:20.454182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-58acc1c0-9034-48f2-a9b0-faca9de55f87 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:20.454667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-58acc1c0-9034-48f2-a9b0-faca9de55f87 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:20.455433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-58acc1c0-9034-48f2-a9b0-faca9de55f87 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:20.455863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-58acc1c0-9034-48f2-a9b0-faca9de55f87 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:20.484505 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-58acc1c0-9034-48f2-a9b0-faca9de55f87 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041684 Nov 08 17:44:20.485070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 535/1046] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:20.673458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ed1b8a07-13c7-4d80-bc15-07b9cc4f1960 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:20.674350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ed1b8a07-13c7-4d80-bc15-07b9cc4f1960 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:20.681454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed1b8a07-13c7-4d80-bc15-07b9cc4f1960 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:20.681894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed1b8a07-13c7-4d80-bc15-07b9cc4f1960 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:20.682686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed1b8a07-13c7-4d80-bc15-07b9cc4f1960 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:20.683129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed1b8a07-13c7-4d80-bc15-07b9cc4f1960 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:20.710890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ed1b8a07-13c7-4d80-bc15-07b9cc4f1960 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041606 Nov 08 17:44:20.711442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 512/1047] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:21.305273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f0e1db57-d099-48d1-9832-37ab445be6da tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec378160>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:21.353456 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f0e1db57-d099-48d1-9832-37ab445be6da tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053298 Nov 08 17:44:21.354253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 536/1048] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:21 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:21.496168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4824fdc8-151d-45f7-8921-860f25b66d7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:21.497103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4824fdc8-151d-45f7-8921-860f25b66d7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:21.502868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4824fdc8-151d-45f7-8921-860f25b66d7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:21.503311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4824fdc8-151d-45f7-8921-860f25b66d7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:21.508764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4824fdc8-151d-45f7-8921-860f25b66d7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:21.508764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4824fdc8-151d-45f7-8921-860f25b66d7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:21.533127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4824fdc8-151d-45f7-8921-860f25b66d7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 Nov 08 17:44:21.533690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 513/1049] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:21.722627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5ace14ec-aca5-49a5-99cc-a997e829d867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:21.723522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5ace14ec-aca5-49a5-99cc-a997e829d867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:21.730131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5ace14ec-aca5-49a5-99cc-a997e829d867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:21.730613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5ace14ec-aca5-49a5-99cc-a997e829d867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:21.731385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5ace14ec-aca5-49a5-99cc-a997e829d867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:21.731815 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5ace14ec-aca5-49a5-99cc-a997e829d867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:21.760972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5ace14ec-aca5-49a5-99cc-a997e829d867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042555 Nov 08 17:44:21.761518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 537/1050] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:22.366485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8054e1c0-b7b5-4832-8959-88882a9a3134 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c3a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:22.411965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8054e1c0-b7b5-4832-8959-88882a9a3134 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049708 Nov 08 17:44:22.412541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 514/1051] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:22 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:22.544755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2bbcff2d-5f13-4bd3-a700-bdefd878056c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:22.545668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2bbcff2d-5f13-4bd3-a700-bdefd878056c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:22.551469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2bbcff2d-5f13-4bd3-a700-bdefd878056c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:22.552530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2bbcff2d-5f13-4bd3-a700-bdefd878056c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:22.553392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2bbcff2d-5f13-4bd3-a700-bdefd878056c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:22.553826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2bbcff2d-5f13-4bd3-a700-bdefd878056c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:22.581487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2bbcff2d-5f13-4bd3-a700-bdefd878056c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040395 Nov 08 17:44:22.582033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 538/1052] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:22.772388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1a0052b9-d29b-458e-aae7-3cee99057c6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:22.773211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1a0052b9-d29b-458e-aae7-3cee99057c6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:22.779751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a0052b9-d29b-458e-aae7-3cee99057c6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:22.780196 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a0052b9-d29b-458e-aae7-3cee99057c6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:22.780963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a0052b9-d29b-458e-aae7-3cee99057c6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:22.781391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a0052b9-d29b-458e-aae7-3cee99057c6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:22.810222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1a0052b9-d29b-458e-aae7-3cee99057c6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041697 Nov 08 17:44:22.810799 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 515/1053] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:23.424025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9a203f54-b81a-4096-9e45-38f8afe01081 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec28d700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:23.470346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9a203f54-b81a-4096-9e45-38f8afe01081 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049904 Nov 08 17:44:23.470953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 539/1054] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:23 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:23.592659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8c16b092-cd68-4891-966d-f7cf253f9f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:23.593627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8c16b092-cd68-4891-966d-f7cf253f9f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:23.599853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c16b092-cd68-4891-966d-f7cf253f9f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:23.600318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c16b092-cd68-4891-966d-f7cf253f9f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:23.601065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c16b092-cd68-4891-966d-f7cf253f9f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:23.601498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c16b092-cd68-4891-966d-f7cf253f9f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:23.630651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8c16b092-cd68-4891-966d-f7cf253f9f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041033 Nov 08 17:44:23.631204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 516/1055] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:23.821687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8ea97877-1a1d-4ae5-9bec-e72d4c449630 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:23.822524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8ea97877-1a1d-4ae5-9bec-e72d4c449630 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:23.829001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ea97877-1a1d-4ae5-9bec-e72d4c449630 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:23.829441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ea97877-1a1d-4ae5-9bec-e72d4c449630 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:23.830198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ea97877-1a1d-4ae5-9bec-e72d4c449630 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:23.830660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ea97877-1a1d-4ae5-9bec-e72d4c449630 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:23.857859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8ea97877-1a1d-4ae5-9bec-e72d4c449630 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040650 Nov 08 17:44:23.858393 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 540/1056] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:24.483978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8acc6745-9358-40cd-b56e-9493d11b2ee8 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c0700>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:24.528870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8acc6745-9358-40cd-b56e-9493d11b2ee8 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048999 Nov 08 17:44:24.529440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 517/1057] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:24 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:24.640812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4688b63f-09e4-4e42-83d6-856b3030d6d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:24.641711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4688b63f-09e4-4e42-83d6-856b3030d6d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:24.648563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4688b63f-09e4-4e42-83d6-856b3030d6d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:24.649005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4688b63f-09e4-4e42-83d6-856b3030d6d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:24.649760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4688b63f-09e4-4e42-83d6-856b3030d6d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:24.650188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4688b63f-09e4-4e42-83d6-856b3030d6d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:24.678648 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4688b63f-09e4-4e42-83d6-856b3030d6d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041466 Nov 08 17:44:24.688248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 541/1058] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:24.869826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e68493b1-082c-4651-ba7b-1083f787a163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:24.870777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e68493b1-082c-4651-ba7b-1083f787a163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:24.877242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e68493b1-082c-4651-ba7b-1083f787a163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:24.877684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e68493b1-082c-4651-ba7b-1083f787a163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:24.878441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e68493b1-082c-4651-ba7b-1083f787a163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:24.878889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e68493b1-082c-4651-ba7b-1083f787a163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:24.906782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e68493b1-082c-4651-ba7b-1083f787a163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041376 Nov 08 17:44:24.907324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 518/1059] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:25.541650 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-74cedef0-674f-46da-9c6d-ef1862fc9319 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec28d700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:25.590637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-74cedef0-674f-46da-9c6d-ef1862fc9319 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052520 Nov 08 17:44:25.591426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 542/1060] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:25 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:25.697903 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b3216c02-8b00-42d4-9612-c8380991e4bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:25.698838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b3216c02-8b00-42d4-9612-c8380991e4bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:25.704534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3216c02-8b00-42d4-9612-c8380991e4bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:25.704969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3216c02-8b00-42d4-9612-c8380991e4bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:25.705731 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3216c02-8b00-42d4-9612-c8380991e4bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:25.706157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3216c02-8b00-42d4-9612-c8380991e4bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:25.743594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b3216c02-8b00-42d4-9612-c8380991e4bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049393 Nov 08 17:44:25.744140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 519/1061] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:25.918431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2f8a148e-5f38-40cd-92cb-8de04a679d9f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:25.919419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2f8a148e-5f38-40cd-92cb-8de04a679d9f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:25.925893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f8a148e-5f38-40cd-92cb-8de04a679d9f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:25.926330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f8a148e-5f38-40cd-92cb-8de04a679d9f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:25.927691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f8a148e-5f38-40cd-92cb-8de04a679d9f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:25.932897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f8a148e-5f38-40cd-92cb-8de04a679d9f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:25.957655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2f8a148e-5f38-40cd-92cb-8de04a679d9f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044024 Nov 08 17:44:25.961321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 543/1062] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:26.603576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8b7bb3d3-80df-482a-b167-f6fe2e8fd511 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec353d30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:26.648855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8b7bb3d3-80df-482a-b167-f6fe2e8fd511 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048835 Nov 08 17:44:26.649411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 520/1063] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:26 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:26.754814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f23003b3-a272-444b-8b46-499adcb0e22f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:26.755754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f23003b3-a272-444b-8b46-499adcb0e22f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:26.761399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f23003b3-a272-444b-8b46-499adcb0e22f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:26.761835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f23003b3-a272-444b-8b46-499adcb0e22f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:26.762647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f23003b3-a272-444b-8b46-499adcb0e22f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:26.763080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f23003b3-a272-444b-8b46-499adcb0e22f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:26.791686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f23003b3-a272-444b-8b46-499adcb0e22f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040677 Nov 08 17:44:26.792220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 544/1064] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:26.969198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1158f953-0681-49f3-899f-7787e3c21741 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:26.970234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1158f953-0681-49f3-899f-7787e3c21741 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:26.976986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1158f953-0681-49f3-899f-7787e3c21741 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:26.977433 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1158f953-0681-49f3-899f-7787e3c21741 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:26.978197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1158f953-0681-49f3-899f-7787e3c21741 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:26.978653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1158f953-0681-49f3-899f-7787e3c21741 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:27.008200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1158f953-0681-49f3-899f-7787e3c21741 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042717 Nov 08 17:44:27.008689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 521/1065] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:27.660858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-df9a82cf-a2b3-4431-bbe9-bb6ff9b7a3c2 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24a670>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:27.706185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-df9a82cf-a2b3-4431-bbe9-bb6ff9b7a3c2 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048898 Nov 08 17:44:27.706794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 545/1066] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:27 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:27.802773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-764127e3-ad6b-4541-8b1c-28e681afda4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:27.803677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-764127e3-ad6b-4541-8b1c-28e681afda4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:27.809776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-764127e3-ad6b-4541-8b1c-28e681afda4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:27.810217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-764127e3-ad6b-4541-8b1c-28e681afda4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:27.811023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-764127e3-ad6b-4541-8b1c-28e681afda4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:27.811457 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-764127e3-ad6b-4541-8b1c-28e681afda4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:27.838638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-764127e3-ad6b-4541-8b1c-28e681afda4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040234 Nov 08 17:44:27.839180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 522/1067] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:28.019511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-17395d72-d628-45d4-8a6e-711e218d898f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:28.020413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-17395d72-d628-45d4-8a6e-711e218d898f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:28.027099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17395d72-d628-45d4-8a6e-711e218d898f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:28.027544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17395d72-d628-45d4-8a6e-711e218d898f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:28.028313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17395d72-d628-45d4-8a6e-711e218d898f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:28.028745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17395d72-d628-45d4-8a6e-711e218d898f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:28.057241 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-17395d72-d628-45d4-8a6e-711e218d898f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041487 Nov 08 17:44:28.057788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 546/1068] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:28.719066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d888f4dc-d928-484f-a5f9-ea2f64e114c6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ba700>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:28.763588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d888f4dc-d928-484f-a5f9-ea2f64e114c6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048136 Nov 08 17:44:28.764177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 523/1069] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:28 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:28.848954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a37802e5-2e73-4fdf-814f-1c8193a65733 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:28.849863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a37802e5-2e73-4fdf-814f-1c8193a65733 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:28.856132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a37802e5-2e73-4fdf-814f-1c8193a65733 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:28.856578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a37802e5-2e73-4fdf-814f-1c8193a65733 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:28.857349 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a37802e5-2e73-4fdf-814f-1c8193a65733 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:28.857779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a37802e5-2e73-4fdf-814f-1c8193a65733 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:28.886700 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a37802e5-2e73-4fdf-814f-1c8193a65733 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041431 Nov 08 17:44:28.887241 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 547/1070] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:29.070037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4db7b2ba-3276-4a31-bc58-9d6a228be110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:29.070917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4db7b2ba-3276-4a31-bc58-9d6a228be110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:29.077384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4db7b2ba-3276-4a31-bc58-9d6a228be110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:29.077835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4db7b2ba-3276-4a31-bc58-9d6a228be110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:29.078654 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4db7b2ba-3276-4a31-bc58-9d6a228be110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:29.079086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4db7b2ba-3276-4a31-bc58-9d6a228be110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:29.106430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4db7b2ba-3276-4a31-bc58-9d6a228be110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041587 Nov 08 17:44:29.107004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 524/1071] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:29.775830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-57c2282a-fb84-48aa-94ed-9414654622e2 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373040>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:29.820858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-57c2282a-fb84-48aa-94ed-9414654622e2 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048579 Nov 08 17:44:29.821426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 548/1072] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:29 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:29.898312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0bfe1f2c-0362-435c-a8f7-d5dc2fb78208 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:29.899229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0bfe1f2c-0362-435c-a8f7-d5dc2fb78208 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:29.905048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bfe1f2c-0362-435c-a8f7-d5dc2fb78208 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:29.905489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bfe1f2c-0362-435c-a8f7-d5dc2fb78208 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:29.906253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bfe1f2c-0362-435c-a8f7-d5dc2fb78208 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:29.906702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bfe1f2c-0362-435c-a8f7-d5dc2fb78208 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:29.935090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0bfe1f2c-0362-435c-a8f7-d5dc2fb78208 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040592 Nov 08 17:44:29.935640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 525/1073] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:30.119219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d05a0726-e704-4332-a77a-84309cc950ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:30.120140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d05a0726-e704-4332-a77a-84309cc950ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:30.126698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d05a0726-e704-4332-a77a-84309cc950ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:30.127150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d05a0726-e704-4332-a77a-84309cc950ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:30.127910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d05a0726-e704-4332-a77a-84309cc950ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:30.128341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d05a0726-e704-4332-a77a-84309cc950ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:30.156804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d05a0726-e704-4332-a77a-84309cc950ee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042693 Nov 08 17:44:30.157339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 549/1074] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:30.833552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-27cb51b0-8955-4b45-98c3-6aea97583a86 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37c940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:30.877821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-27cb51b0-8955-4b45-98c3-6aea97583a86 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048586 Nov 08 17:44:30.878525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 526/1075] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:30 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:30.947099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2b720a57-5731-4558-8517-791f03250720 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:30.948078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2b720a57-5731-4558-8517-791f03250720 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:30.953852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2b720a57-5731-4558-8517-791f03250720 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:30.954294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2b720a57-5731-4558-8517-791f03250720 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:30.955089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2b720a57-5731-4558-8517-791f03250720 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:30.955517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2b720a57-5731-4558-8517-791f03250720 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:30.985075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2b720a57-5731-4558-8517-791f03250720 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042498 Nov 08 17:44:30.985633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 550/1076] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:31.168155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b5b7917a-99a2-47c1-ac62-57a983eceb11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:31.169072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b5b7917a-99a2-47c1-ac62-57a983eceb11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:31.175647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b5b7917a-99a2-47c1-ac62-57a983eceb11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:31.176092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b5b7917a-99a2-47c1-ac62-57a983eceb11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:31.177354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b5b7917a-99a2-47c1-ac62-57a983eceb11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:31.177778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b5b7917a-99a2-47c1-ac62-57a983eceb11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:31.205672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b5b7917a-99a2-47c1-ac62-57a983eceb11 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041285 Nov 08 17:44:31.206212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 527/1077] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:31.890580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ace11a85-f42a-4ae1-8db0-b188c838e8d5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b2040>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:31.940256 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ace11a85-f42a-4ae1-8db0-b188c838e8d5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049393 Nov 08 17:44:31.940256 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 551/1078] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:31 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:32.000913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a6c7bfe3-a196-48c5-b78b-41033b502174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:32.001817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a6c7bfe3-a196-48c5-b78b-41033b502174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:32.007994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6c7bfe3-a196-48c5-b78b-41033b502174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:32.008434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6c7bfe3-a196-48c5-b78b-41033b502174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:32.009208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6c7bfe3-a196-48c5-b78b-41033b502174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:32.009637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6c7bfe3-a196-48c5-b78b-41033b502174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:32.039361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a6c7bfe3-a196-48c5-b78b-41033b502174 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046644 Nov 08 17:44:32.039918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 528/1079] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:32.217213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-19dd1445-d01d-4963-a36f-2f32a5854b4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:32.218041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-19dd1445-d01d-4963-a36f-2f32a5854b4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:32.224684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19dd1445-d01d-4963-a36f-2f32a5854b4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:32.225124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19dd1445-d01d-4963-a36f-2f32a5854b4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:32.225891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19dd1445-d01d-4963-a36f-2f32a5854b4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:32.226324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19dd1445-d01d-4963-a36f-2f32a5854b4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:32.253545 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-19dd1445-d01d-4963-a36f-2f32a5854b4a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040178 Nov 08 17:44:32.254083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 552/1080] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:32.948791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2e215366-b545-49a6-bc33-e0d801c65a93 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec353940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:32.994645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2e215366-b545-49a6-bc33-e0d801c65a93 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049407 Nov 08 17:44:32.995350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 529/1081] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:32 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:33.050689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-678ab67a-da45-4b21-aee8-79996e31cc02 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:33.052164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-678ab67a-da45-4b21-aee8-79996e31cc02 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:33.058431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-678ab67a-da45-4b21-aee8-79996e31cc02 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:33.058905 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-678ab67a-da45-4b21-aee8-79996e31cc02 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:33.059674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-678ab67a-da45-4b21-aee8-79996e31cc02 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:33.060101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-678ab67a-da45-4b21-aee8-79996e31cc02 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:33.089390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-678ab67a-da45-4b21-aee8-79996e31cc02 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 Nov 08 17:44:33.089944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 553/1082] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:33.265604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-24bf32d2-8fd9-46b3-b8ce-99e687636830 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:33.266423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-24bf32d2-8fd9-46b3-b8ce-99e687636830 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:33.273011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24bf32d2-8fd9-46b3-b8ce-99e687636830 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:33.273461 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24bf32d2-8fd9-46b3-b8ce-99e687636830 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:33.274227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24bf32d2-8fd9-46b3-b8ce-99e687636830 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:33.274690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24bf32d2-8fd9-46b3-b8ce-99e687636830 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:33.302936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-24bf32d2-8fd9-46b3-b8ce-99e687636830 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041648 Nov 08 17:44:33.303484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 530/1083] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:34.006809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-88313e74-9ebb-42d0-961d-777f1cbc84a2 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c1790>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:34.053629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-88313e74-9ebb-42d0-961d-777f1cbc84a2 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050532 Nov 08 17:44:34.054186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 554/1084] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:34 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:34.101782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5a199e3b-3aa8-4720-aadd-b0af36e845a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:34.102744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5a199e3b-3aa8-4720-aadd-b0af36e845a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:34.108884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a199e3b-3aa8-4720-aadd-b0af36e845a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:34.109337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a199e3b-3aa8-4720-aadd-b0af36e845a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:34.110123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a199e3b-3aa8-4720-aadd-b0af36e845a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:34.110677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a199e3b-3aa8-4720-aadd-b0af36e845a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:34.141403 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5a199e3b-3aa8-4720-aadd-b0af36e845a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Nov 08 17:44:34.141960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 531/1085] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:34.314766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a958e1f4-85bd-4c6c-9e38-90e0a9c1a57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:34.315572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a958e1f4-85bd-4c6c-9e38-90e0a9c1a57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:34.322339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a958e1f4-85bd-4c6c-9e38-90e0a9c1a57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:34.322804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a958e1f4-85bd-4c6c-9e38-90e0a9c1a57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:34.323573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a958e1f4-85bd-4c6c-9e38-90e0a9c1a57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:34.323999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a958e1f4-85bd-4c6c-9e38-90e0a9c1a57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:34.352745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a958e1f4-85bd-4c6c-9e38-90e0a9c1a57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042339 Nov 08 17:44:34.353295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 555/1086] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:35.065977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c4212b0e-74da-46b4-a79b-8d20d4fad19c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec251dc0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:35.110944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c4212b0e-74da-46b4-a79b-8d20d4fad19c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048579 Nov 08 17:44:35.111727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 532/1087] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:35 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:35.152536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-aeb09bb9-b215-42b9-89b9-53e4a24f2ddd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:35.153448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-aeb09bb9-b215-42b9-89b9-53e4a24f2ddd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:35.159281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aeb09bb9-b215-42b9-89b9-53e4a24f2ddd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:35.159695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aeb09bb9-b215-42b9-89b9-53e4a24f2ddd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:35.160818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aeb09bb9-b215-42b9-89b9-53e4a24f2ddd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:35.161262 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aeb09bb9-b215-42b9-89b9-53e4a24f2ddd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:35.190488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-aeb09bb9-b215-42b9-89b9-53e4a24f2ddd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Nov 08 17:44:35.191140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 556/1088] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:35.363981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7ec5a283-9c8b-48a3-977b-a2c2414967bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:35.365478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7ec5a283-9c8b-48a3-977b-a2c2414967bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:35.371621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ec5a283-9c8b-48a3-977b-a2c2414967bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:35.372063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ec5a283-9c8b-48a3-977b-a2c2414967bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:35.372820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ec5a283-9c8b-48a3-977b-a2c2414967bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:35.373246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ec5a283-9c8b-48a3-977b-a2c2414967bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:35.401441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7ec5a283-9c8b-48a3-977b-a2c2414967bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041270 Nov 08 17:44:35.401995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 533/1089] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:36.124104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4a3e5e85-926e-419d-b5c2-760bcdd6746e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c1280>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:36.171196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4a3e5e85-926e-419d-b5c2-760bcdd6746e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050271 Nov 08 17:44:36.171779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 557/1090] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:36 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:36.205576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aaf99e79-25ff-4f7d-b2ec-84edb90c8f4e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:36.205576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aaf99e79-25ff-4f7d-b2ec-84edb90c8f4e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:36.210773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aaf99e79-25ff-4f7d-b2ec-84edb90c8f4e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:36.211219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aaf99e79-25ff-4f7d-b2ec-84edb90c8f4e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:36.212001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aaf99e79-25ff-4f7d-b2ec-84edb90c8f4e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:36.212433 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aaf99e79-25ff-4f7d-b2ec-84edb90c8f4e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:36.242450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aaf99e79-25ff-4f7d-b2ec-84edb90c8f4e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043788 Nov 08 17:44:36.243228 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 534/1091] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:36.413283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f32784da-4bf4-4cc9-9a22-3b423b622f67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:36.414105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f32784da-4bf4-4cc9-9a22-3b423b622f67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:36.420671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f32784da-4bf4-4cc9-9a22-3b423b622f67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:36.421116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f32784da-4bf4-4cc9-9a22-3b423b622f67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:36.421876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f32784da-4bf4-4cc9-9a22-3b423b622f67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:36.422301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f32784da-4bf4-4cc9-9a22-3b423b622f67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:36.450801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f32784da-4bf4-4cc9-9a22-3b423b622f67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041514 Nov 08 17:44:36.451353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 558/1092] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:37.182856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bca680ae-49a9-4de8-88f1-2e44f40b2971 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f5e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:37.227408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bca680ae-49a9-4de8-88f1-2e44f40b2971 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048285 Nov 08 17:44:37.228291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 535/1093] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:37 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:37.253393 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f334d7df-873e-4b22-9412-d9037988d8d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:37.254295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f334d7df-873e-4b22-9412-d9037988d8d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:37.260620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f334d7df-873e-4b22-9412-d9037988d8d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:37.261060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f334d7df-873e-4b22-9412-d9037988d8d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:37.261827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f334d7df-873e-4b22-9412-d9037988d8d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:37.262297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f334d7df-873e-4b22-9412-d9037988d8d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:37.293342 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f334d7df-873e-4b22-9412-d9037988d8d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 Nov 08 17:44:37.293915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 559/1094] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:37.462989 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aafb9e58-c272-4b34-82d1-7e183c56bd7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:37.463945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aafb9e58-c272-4b34-82d1-7e183c56bd7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:37.469910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aafb9e58-c272-4b34-82d1-7e183c56bd7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:37.470356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aafb9e58-c272-4b34-82d1-7e183c56bd7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:37.471158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aafb9e58-c272-4b34-82d1-7e183c56bd7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:37.471585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aafb9e58-c272-4b34-82d1-7e183c56bd7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:37.500463 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aafb9e58-c272-4b34-82d1-7e183c56bd7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041972 Nov 08 17:44:37.500968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 536/1095] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:38.239658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-71b41225-a0d9-4aec-ac09-02874ce3b087 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b69d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:38.284596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-71b41225-a0d9-4aec-ac09-02874ce3b087 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048592 Nov 08 17:44:38.285436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 560/1096] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:38 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:38.304509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-86ff4125-997a-40d6-a17e-c78a30b6d3bb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:38.306048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-86ff4125-997a-40d6-a17e-c78a30b6d3bb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:38.314900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86ff4125-997a-40d6-a17e-c78a30b6d3bb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:38.315353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86ff4125-997a-40d6-a17e-c78a30b6d3bb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:38.316169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86ff4125-997a-40d6-a17e-c78a30b6d3bb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:38.316603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86ff4125-997a-40d6-a17e-c78a30b6d3bb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:38.348571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-86ff4125-997a-40d6-a17e-c78a30b6d3bb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Nov 08 17:44:38.349133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 537/1097] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:38.512051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8b207f25-a212-4fba-8449-6d95c954c6a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:38.512962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8b207f25-a212-4fba-8449-6d95c954c6a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:38.519665 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b207f25-a212-4fba-8449-6d95c954c6a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:38.520114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b207f25-a212-4fba-8449-6d95c954c6a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:38.520877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b207f25-a212-4fba-8449-6d95c954c6a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:38.521309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b207f25-a212-4fba-8449-6d95c954c6a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:38.551119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8b207f25-a212-4fba-8449-6d95c954c6a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043075 Nov 08 17:44:38.551659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 561/1098] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:39.296876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c4472e17-26ee-4c25-860e-4d9777005a3a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec390280>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:39.342092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c4472e17-26ee-4c25-860e-4d9777005a3a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048855 Nov 08 17:44:39.342917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 538/1099] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:39 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:39.359681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-62272798-9c8b-49fb-a3cb-9382fb18fb35 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:39.360596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-62272798-9c8b-49fb-a3cb-9382fb18fb35 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:39.367144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62272798-9c8b-49fb-a3cb-9382fb18fb35 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:39.368113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62272798-9c8b-49fb-a3cb-9382fb18fb35 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:39.368921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62272798-9c8b-49fb-a3cb-9382fb18fb35 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:39.369358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62272798-9c8b-49fb-a3cb-9382fb18fb35 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:39.400783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-62272798-9c8b-49fb-a3cb-9382fb18fb35 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Nov 08 17:44:39.401337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 562/1100] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:39.562726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b67ec751-5cd7-4e79-bcd1-55a649976d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:39.563532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b67ec751-5cd7-4e79-bcd1-55a649976d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:39.570119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b67ec751-5cd7-4e79-bcd1-55a649976d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:39.570589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b67ec751-5cd7-4e79-bcd1-55a649976d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:39.572097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b67ec751-5cd7-4e79-bcd1-55a649976d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:39.572525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b67ec751-5cd7-4e79-bcd1-55a649976d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:39.600024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b67ec751-5cd7-4e79-bcd1-55a649976d38 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041318 Nov 08 17:44:39.600575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 539/1101] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:40.354944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-19ff1d79-fb12-45d8-9980-c43d0cbd8c09 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2af0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:40.401213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-19ff1d79-fb12-45d8-9980-c43d0cbd8c09 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050591 Nov 08 17:44:40.402060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 563/1102] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:40 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:40.411908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-24a6c3ce-a0be-4546-a23f-96b6c4c920f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:40.412871 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-24a6c3ce-a0be-4546-a23f-96b6c4c920f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:40.419467 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24a6c3ce-a0be-4546-a23f-96b6c4c920f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:40.419972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24a6c3ce-a0be-4546-a23f-96b6c4c920f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:40.420789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24a6c3ce-a0be-4546-a23f-96b6c4c920f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:40.421208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24a6c3ce-a0be-4546-a23f-96b6c4c920f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:40.451969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-24a6c3ce-a0be-4546-a23f-96b6c4c920f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Nov 08 17:44:40.452731 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 540/1103] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:40.611978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8476a2de-d18d-4918-a58c-99a1d6eccb99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:40.612884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8476a2de-d18d-4918-a58c-99a1d6eccb99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:40.619835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8476a2de-d18d-4918-a58c-99a1d6eccb99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:40.620306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8476a2de-d18d-4918-a58c-99a1d6eccb99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:40.621077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8476a2de-d18d-4918-a58c-99a1d6eccb99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:40.621506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8476a2de-d18d-4918-a58c-99a1d6eccb99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:40.651330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8476a2de-d18d-4918-a58c-99a1d6eccb99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043202 Nov 08 17:44:40.651887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 564/1104] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:41.413425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6f97fd17-bc62-4703-b9df-56d362732706 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2db4c0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:41.459398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6f97fd17-bc62-4703-b9df-56d362732706 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049529 Nov 08 17:44:41.460099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 541/1105] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:41 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:41.465108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-de3b5ffa-dc17-4823-992c-44f6d417223f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:41.466076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-de3b5ffa-dc17-4823-992c-44f6d417223f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:41.472414 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-de3b5ffa-dc17-4823-992c-44f6d417223f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:41.472857 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-de3b5ffa-dc17-4823-992c-44f6d417223f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:41.473770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-de3b5ffa-dc17-4823-992c-44f6d417223f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:41.474105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-de3b5ffa-dc17-4823-992c-44f6d417223f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:41.505173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-de3b5ffa-dc17-4823-992c-44f6d417223f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Nov 08 17:44:41.506036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 565/1106] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:41.663174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1a9f6d4a-0f14-4532-9697-00b240d78e78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:41.664077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1a9f6d4a-0f14-4532-9697-00b240d78e78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:41.671560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a9f6d4a-0f14-4532-9697-00b240d78e78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:41.672007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a9f6d4a-0f14-4532-9697-00b240d78e78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:41.672772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a9f6d4a-0f14-4532-9697-00b240d78e78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:41.673197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a9f6d4a-0f14-4532-9697-00b240d78e78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:41.701169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1a9f6d4a-0f14-4532-9697-00b240d78e78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041936 Nov 08 17:44:41.701710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 542/1107] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:42.472610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d6a617fd-c5aa-4b06-b52d-64a6c7f5e423 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b20d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:42.516354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a4927d07-bfa2-46b2-8196-37613c280605 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:42.517264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a4927d07-bfa2-46b2-8196-37613c280605 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:42.519574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d6a617fd-c5aa-4b06-b52d-64a6c7f5e423 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050437 Nov 08 17:44:42.521080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 566/1108] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:42 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:42.523931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4927d07-bfa2-46b2-8196-37613c280605 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:42.524452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4927d07-bfa2-46b2-8196-37613c280605 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:42.525173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4927d07-bfa2-46b2-8196-37613c280605 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:42.525610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4927d07-bfa2-46b2-8196-37613c280605 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:42.555953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a4927d07-bfa2-46b2-8196-37613c280605 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Nov 08 17:44:42.556868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 543/1109] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:42.713174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f6932cd0-4714-4bcb-a510-f3067061454b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:42.714097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f6932cd0-4714-4bcb-a510-f3067061454b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:42.720679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6932cd0-4714-4bcb-a510-f3067061454b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:42.721129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6932cd0-4714-4bcb-a510-f3067061454b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:42.721934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6932cd0-4714-4bcb-a510-f3067061454b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:42.722367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6932cd0-4714-4bcb-a510-f3067061454b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:42.752366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f6932cd0-4714-4bcb-a510-f3067061454b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043477 Nov 08 17:44:42.752847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 567/1110] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:43.536669 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d8c27ced-85af-411b-a03d-325a60157321 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ba280>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:43.568405 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-90d40452-9d70-4ede-b10e-427075dd702e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:43.569315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-90d40452-9d70-4ede-b10e-427075dd702e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:43.576368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90d40452-9d70-4ede-b10e-427075dd702e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:43.576821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90d40452-9d70-4ede-b10e-427075dd702e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:43.577687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90d40452-9d70-4ede-b10e-427075dd702e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:43.578116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90d40452-9d70-4ede-b10e-427075dd702e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:43.582585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d8c27ced-85af-411b-a03d-325a60157321 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049435 Nov 08 17:44:43.583151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 544/1111] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:43 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:43.608148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-90d40452-9d70-4ede-b10e-427075dd702e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Nov 08 17:44:43.608714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 568/1112] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:43.764580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1fae05a4-6d90-44e0-ac0a-81de5bd9fe81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:43.765480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1fae05a4-6d90-44e0-ac0a-81de5bd9fe81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:43.771272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fae05a4-6d90-44e0-ac0a-81de5bd9fe81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:43.771716 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fae05a4-6d90-44e0-ac0a-81de5bd9fe81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:43.772476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fae05a4-6d90-44e0-ac0a-81de5bd9fe81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:43.772905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fae05a4-6d90-44e0-ac0a-81de5bd9fe81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:43.802555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1fae05a4-6d90-44e0-ac0a-81de5bd9fe81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041619 Nov 08 17:44:43.803031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 545/1113] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:44.595653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a0e9407b-539c-4f36-b6bd-ad6a2840d91e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c280>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:44.620094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-954e2650-7922-416c-a104-42b1b6a790dd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:44.620998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-954e2650-7922-416c-a104-42b1b6a790dd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:44.627216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-954e2650-7922-416c-a104-42b1b6a790dd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:44.627659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-954e2650-7922-416c-a104-42b1b6a790dd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:44.628432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-954e2650-7922-416c-a104-42b1b6a790dd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:44.628867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-954e2650-7922-416c-a104-42b1b6a790dd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:44.642430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a0e9407b-539c-4f36-b6bd-ad6a2840d91e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050380 Nov 08 17:44:44.643221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 569/1114] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:44 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:44.658364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-954e2650-7922-416c-a104-42b1b6a790dd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042724 Nov 08 17:44:44.659234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 546/1115] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:44.814812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-736a9dde-69f7-4bd6-9b03-a10eae1deac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:44.815637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-736a9dde-69f7-4bd6-9b03-a10eae1deac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:44.822944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-736a9dde-69f7-4bd6-9b03-a10eae1deac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:44.823386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-736a9dde-69f7-4bd6-9b03-a10eae1deac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:44.824142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-736a9dde-69f7-4bd6-9b03-a10eae1deac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:44.824569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-736a9dde-69f7-4bd6-9b03-a10eae1deac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:44.852683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-736a9dde-69f7-4bd6-9b03-a10eae1deac7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040991 Nov 08 17:44:44.853220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 570/1116] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:45.655245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-36077080-b205-4ac9-b953-ae1916408265 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:45.669277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-99ec24ff-f371-4e87-af5e-ba388a6650d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:45.670185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-99ec24ff-f371-4e87-af5e-ba388a6650d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:45.677620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-99ec24ff-f371-4e87-af5e-ba388a6650d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:45.678082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-99ec24ff-f371-4e87-af5e-ba388a6650d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:45.678904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-99ec24ff-f371-4e87-af5e-ba388a6650d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:45.679340 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-99ec24ff-f371-4e87-af5e-ba388a6650d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:45.708206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-36077080-b205-4ac9-b953-ae1916408265 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.056551 Nov 08 17:44:45.712300 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-99ec24ff-f371-4e87-af5e-ba388a6650d6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045930 Nov 08 17:44:45.713065 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 571/1117] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:45.714088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 547/1118] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:45 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:45.864222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c2b6e9e9-64bb-46ce-a6c5-ec4bbad7c166 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:45.865119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c2b6e9e9-64bb-46ce-a6c5-ec4bbad7c166 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:45.871486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2b6e9e9-64bb-46ce-a6c5-ec4bbad7c166 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:45.871925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2b6e9e9-64bb-46ce-a6c5-ec4bbad7c166 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:45.872687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2b6e9e9-64bb-46ce-a6c5-ec4bbad7c166 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:45.873116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2b6e9e9-64bb-46ce-a6c5-ec4bbad7c166 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:45.903375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c2b6e9e9-64bb-46ce-a6c5-ec4bbad7c166 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042934 Nov 08 17:44:45.903925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 572/1119] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:46.721561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-37ea0eab-043c-49e3-8dcf-f85373c94032 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec251160>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:46.723206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1d344361-b7ed-4c0f-ae72-f459da435d49 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:46.724130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1d344361-b7ed-4c0f-ae72-f459da435d49 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:46.730955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d344361-b7ed-4c0f-ae72-f459da435d49 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:46.731395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d344361-b7ed-4c0f-ae72-f459da435d49 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:46.732157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d344361-b7ed-4c0f-ae72-f459da435d49 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:46.732584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d344361-b7ed-4c0f-ae72-f459da435d49 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:46.761865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1d344361-b7ed-4c0f-ae72-f459da435d49 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Nov 08 17:44:46.762423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 573/1120] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:46.766321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-37ea0eab-043c-49e3-8dcf-f85373c94032 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048746 Nov 08 17:44:46.766911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 548/1121] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:46 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:46.915525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-48a8e908-f6c3-490a-817a-3939bc64b7e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:46.916419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-48a8e908-f6c3-490a-817a-3939bc64b7e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:46.922171 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-48a8e908-f6c3-490a-817a-3939bc64b7e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:46.922636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-48a8e908-f6c3-490a-817a-3939bc64b7e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:46.923397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-48a8e908-f6c3-490a-817a-3939bc64b7e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:46.923822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-48a8e908-f6c3-490a-817a-3939bc64b7e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:46.953186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-48a8e908-f6c3-490a-817a-3939bc64b7e6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042137 Nov 08 17:44:46.953745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 574/1122] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:47.773149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f62b029f-1f71-48fc-b382-a1fac1a5fb7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:47.774915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f62b029f-1f71-48fc-b382-a1fac1a5fb7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:47.778803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bdbc1db7-41cd-4495-8378-e44f49dbb409 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3783a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:47.780866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f62b029f-1f71-48fc-b382-a1fac1a5fb7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:47.781316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f62b029f-1f71-48fc-b382-a1fac1a5fb7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:47.782092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f62b029f-1f71-48fc-b382-a1fac1a5fb7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:47.782559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f62b029f-1f71-48fc-b382-a1fac1a5fb7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:47.811955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f62b029f-1f71-48fc-b382-a1fac1a5fb7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042995 Nov 08 17:44:47.812517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 549/1123] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:47.825455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bdbc1db7-41cd-4495-8378-e44f49dbb409 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050209 Nov 08 17:44:47.826031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 575/1124] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:47 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:47.963895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c9589f9c-dcd5-4b3f-8947-c8f9881e8e4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:47.964743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c9589f9c-dcd5-4b3f-8947-c8f9881e8e4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:47.970616 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c9589f9c-dcd5-4b3f-8947-c8f9881e8e4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:47.971068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c9589f9c-dcd5-4b3f-8947-c8f9881e8e4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:47.971842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c9589f9c-dcd5-4b3f-8947-c8f9881e8e4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:47.972277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c9589f9c-dcd5-4b3f-8947-c8f9881e8e4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:48.002314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c9589f9c-dcd5-4b3f-8947-c8f9881e8e4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042380 Nov 08 17:44:48.002911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 550/1125] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:48.824341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fce8c256-2197-4a76-89b9-67fa6e34e6b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:48.825152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fce8c256-2197-4a76-89b9-67fa6e34e6b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:48.831731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fce8c256-2197-4a76-89b9-67fa6e34e6b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:48.832176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fce8c256-2197-4a76-89b9-67fa6e34e6b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:48.832944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fce8c256-2197-4a76-89b9-67fa6e34e6b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:48.833375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fce8c256-2197-4a76-89b9-67fa6e34e6b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:48.838023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ef20b8c5-c2a8-4069-b372-54c49068e103 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ba9d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:48.863100 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fce8c256-2197-4a76-89b9-67fa6e34e6b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Nov 08 17:44:48.863675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 576/1126] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:48.884134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ef20b8c5-c2a8-4069-b372-54c49068e103 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050585 Nov 08 17:44:48.884734 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 551/1127] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:48 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:49.013742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-467083d6-2319-4e05-bcd6-606064e987db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:49.014684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-467083d6-2319-4e05-bcd6-606064e987db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:49.020792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-467083d6-2319-4e05-bcd6-606064e987db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:49.021240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-467083d6-2319-4e05-bcd6-606064e987db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:49.022019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-467083d6-2319-4e05-bcd6-606064e987db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:49.022451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-467083d6-2319-4e05-bcd6-606064e987db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:49.050938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-467083d6-2319-4e05-bcd6-606064e987db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040932 Nov 08 17:44:49.051486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 577/1128] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:49.875183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-569aff53-08d1-49fb-b7cd-dc0add398b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:49.876072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-569aff53-08d1-49fb-b7cd-dc0add398b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:49.882642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-569aff53-08d1-49fb-b7cd-dc0add398b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:49.883710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-569aff53-08d1-49fb-b7cd-dc0add398b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:49.884466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-569aff53-08d1-49fb-b7cd-dc0add398b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:49.884889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-569aff53-08d1-49fb-b7cd-dc0add398b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:49.896071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5b5c087b-84bd-4c26-b091-1ba2a17b56c5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2e5280>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:49.913020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-569aff53-08d1-49fb-b7cd-dc0add398b13 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041992 Nov 08 17:44:49.913581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 552/1129] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:49.940716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5b5c087b-84bd-4c26-b091-1ba2a17b56c5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048088 Nov 08 17:44:49.941285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 578/1130] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:49 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:50.062834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-02ffb142-5406-4f29-bebb-1f511c0494ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:50.063726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-02ffb142-5406-4f29-bebb-1f511c0494ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:50.069439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02ffb142-5406-4f29-bebb-1f511c0494ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:50.069881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02ffb142-5406-4f29-bebb-1f511c0494ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:50.071362 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02ffb142-5406-4f29-bebb-1f511c0494ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:50.071797 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02ffb142-5406-4f29-bebb-1f511c0494ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:50.098863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-02ffb142-5406-4f29-bebb-1f511c0494ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039724 Nov 08 17:44:50.099400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 553/1131] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:50.925055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-128aa9ec-2944-46a5-a449-c43abd68b31e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:50.925945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-128aa9ec-2944-46a5-a449-c43abd68b31e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:50.932574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-128aa9ec-2944-46a5-a449-c43abd68b31e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:50.932971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-128aa9ec-2944-46a5-a449-c43abd68b31e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:50.940118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-128aa9ec-2944-46a5-a449-c43abd68b31e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:50.940118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-128aa9ec-2944-46a5-a449-c43abd68b31e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:50.952840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cb212149-a541-4b27-9531-73874eabc524 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24b430>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:50.963097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-128aa9ec-2944-46a5-a449-c43abd68b31e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042200 Nov 08 17:44:50.963652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 579/1132] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:50.998184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cb212149-a541-4b27-9531-73874eabc524 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048852 Nov 08 17:44:50.999042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 554/1133] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:50 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:51.110791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-50598980-7d26-42fd-a259-e93a83924451 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:51.111688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-50598980-7d26-42fd-a259-e93a83924451 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:51.117755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-50598980-7d26-42fd-a259-e93a83924451 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:51.118196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-50598980-7d26-42fd-a259-e93a83924451 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:51.118990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-50598980-7d26-42fd-a259-e93a83924451 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:51.119421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-50598980-7d26-42fd-a259-e93a83924451 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:51.146788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-50598980-7d26-42fd-a259-e93a83924451 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039758 Nov 08 17:44:51.147320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 580/1134] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:51.975161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b00d3f44-9582-4300-999a-9b6679a5098b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:51.976052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b00d3f44-9582-4300-999a-9b6679a5098b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:51.983309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b00d3f44-9582-4300-999a-9b6679a5098b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:51.987952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b00d3f44-9582-4300-999a-9b6679a5098b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:51.987952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b00d3f44-9582-4300-999a-9b6679a5098b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:51.987952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b00d3f44-9582-4300-999a-9b6679a5098b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:52.010655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-93d39812-b037-4798-9c44-a777f94661fd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec287e50>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:52.014023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b00d3f44-9582-4300-999a-9b6679a5098b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Nov 08 17:44:52.014606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 555/1135] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:52.055627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-93d39812-b037-4798-9c44-a777f94661fd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048571 Nov 08 17:44:52.056320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 581/1136] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:52 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:52.157684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e43128d3-a9c0-48cb-b7fd-241c510232f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:52.158610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e43128d3-a9c0-48cb-b7fd-241c510232f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:52.164278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e43128d3-a9c0-48cb-b7fd-241c510232f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:52.164718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e43128d3-a9c0-48cb-b7fd-241c510232f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:52.165479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e43128d3-a9c0-48cb-b7fd-241c510232f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:52.165901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e43128d3-a9c0-48cb-b7fd-241c510232f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:52.194794 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e43128d3-a9c0-48cb-b7fd-241c510232f5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040787 Nov 08 17:44:52.195337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 556/1137] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:44:53.025937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a52e9274-cea8-4b1c-b181-d44e90d481c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:53.026899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a52e9274-cea8-4b1c-b181-d44e90d481c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:53.033519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a52e9274-cea8-4b1c-b181-d44e90d481c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:53.033969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a52e9274-cea8-4b1c-b181-d44e90d481c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:53.034766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a52e9274-cea8-4b1c-b181-d44e90d481c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:53.035211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a52e9274-cea8-4b1c-b181-d44e90d481c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:53.063378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a52e9274-cea8-4b1c-b181-d44e90d481c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042300 Nov 08 17:44:53.063925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 582/1138] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:53.067095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-96a3d557-5819-41e4-b6a8-b79f3aa192e7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2fd1f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:53.116034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-96a3d557-5819-41e4-b6a8-b79f3aa192e7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052279 Nov 08 17:44:53.116604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 557/1139] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:53 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:53.206726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d2212687-24cb-4def-ae52-12b5b9226708 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:53.207619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d2212687-24cb-4def-ae52-12b5b9226708 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:53.213971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2212687-24cb-4def-ae52-12b5b9226708 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:53.214412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2212687-24cb-4def-ae52-12b5b9226708 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:53.215195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2212687-24cb-4def-ae52-12b5b9226708 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:53.215626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2212687-24cb-4def-ae52-12b5b9226708 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:53.243386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d2212687-24cb-4def-ae52-12b5b9226708 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040296 Nov 08 17:44:53.243857 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 583/1140] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:54.074532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f448122e-1d32-4987-adfe-379f653d2a6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:54.075442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f448122e-1d32-4987-adfe-379f653d2a6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:54.082359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f448122e-1d32-4987-adfe-379f653d2a6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:54.082834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f448122e-1d32-4987-adfe-379f653d2a6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:54.083604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f448122e-1d32-4987-adfe-379f653d2a6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:54.084038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f448122e-1d32-4987-adfe-379f653d2a6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:54.111589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f448122e-1d32-4987-adfe-379f653d2a6b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040846 Nov 08 17:44:54.112131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 558/1141] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:54.128064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2775d137-8c94-448f-9f71-3be5ad758245 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec28d430>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:54.173083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2775d137-8c94-448f-9f71-3be5ad758245 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048523 Nov 08 17:44:54.173777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 584/1142] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:54 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:54.254624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-950e27b7-33f5-474f-b378-25a061629867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:54.255601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-950e27b7-33f5-474f-b378-25a061629867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:54.261844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-950e27b7-33f5-474f-b378-25a061629867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:54.262282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-950e27b7-33f5-474f-b378-25a061629867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:54.263075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-950e27b7-33f5-474f-b378-25a061629867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:54.263497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-950e27b7-33f5-474f-b378-25a061629867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:54.292821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-950e27b7-33f5-474f-b378-25a061629867 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041974 Nov 08 17:44:54.293367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 559/1143] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:55.123367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-59bcfc00-1859-4a2b-9bad-c23e4818395e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:55.124296 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-59bcfc00-1859-4a2b-9bad-c23e4818395e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:55.131828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-59bcfc00-1859-4a2b-9bad-c23e4818395e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:55.132446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-59bcfc00-1859-4a2b-9bad-c23e4818395e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:55.133634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-59bcfc00-1859-4a2b-9bad-c23e4818395e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:55.134064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-59bcfc00-1859-4a2b-9bad-c23e4818395e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:55.162624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-59bcfc00-1859-4a2b-9bad-c23e4818395e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042938 Nov 08 17:44:55.163184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 585/1144] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:55.185461 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-26c842fb-fabf-49a9-ac1c-56df7ff45e8e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2519d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:55.231683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-26c842fb-fabf-49a9-ac1c-56df7ff45e8e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049770 Nov 08 17:44:55.232257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 560/1145] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:55 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:55.304105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e59cfd9b-6fbb-4444-8143-76f2ec95696e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:55.305534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e59cfd9b-6fbb-4444-8143-76f2ec95696e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:55.312819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e59cfd9b-6fbb-4444-8143-76f2ec95696e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:55.313193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e59cfd9b-6fbb-4444-8143-76f2ec95696e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:55.314148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e59cfd9b-6fbb-4444-8143-76f2ec95696e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:55.314606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e59cfd9b-6fbb-4444-8143-76f2ec95696e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:55.344008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e59cfd9b-6fbb-4444-8143-76f2ec95696e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043504 Nov 08 17:44:55.344559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 586/1146] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:56.172995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9c9a6699-f0cf-400b-9128-ee1cc020ea83 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:56.173968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9c9a6699-f0cf-400b-9128-ee1cc020ea83 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:56.180801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c9a6699-f0cf-400b-9128-ee1cc020ea83 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:56.181234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c9a6699-f0cf-400b-9128-ee1cc020ea83 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:56.181999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c9a6699-f0cf-400b-9128-ee1cc020ea83 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:56.182425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c9a6699-f0cf-400b-9128-ee1cc020ea83 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:56.210392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9c9a6699-f0cf-400b-9128-ee1cc020ea83 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041144 Nov 08 17:44:56.211712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 561/1147] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:56.243192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0d8333f9-f820-44cc-a95a-25c94e2efc21 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b6a60>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:56.289418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0d8333f9-f820-44cc-a95a-25c94e2efc21 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050032 Nov 08 17:44:56.290106 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 587/1148] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:56 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:56.357960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-78d1c263-af81-43ec-92ee-81c922b0dbe9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:56.358907 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-78d1c263-af81-43ec-92ee-81c922b0dbe9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:56.364620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78d1c263-af81-43ec-92ee-81c922b0dbe9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:56.365066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78d1c263-af81-43ec-92ee-81c922b0dbe9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:56.366095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78d1c263-af81-43ec-92ee-81c922b0dbe9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:56.366545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-78d1c263-af81-43ec-92ee-81c922b0dbe9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:56.395606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-78d1c263-af81-43ec-92ee-81c922b0dbe9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041255 Nov 08 17:44:56.396172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 562/1149] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:57.222383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fb30fe89-ef6d-422d-a44d-8e822d6c16ee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:57.223329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fb30fe89-ef6d-422d-a44d-8e822d6c16ee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:57.230897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb30fe89-ef6d-422d-a44d-8e822d6c16ee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:57.231347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb30fe89-ef6d-422d-a44d-8e822d6c16ee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:57.232148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb30fe89-ef6d-422d-a44d-8e822d6c16ee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:57.232627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb30fe89-ef6d-422d-a44d-8e822d6c16ee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:57.262572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fb30fe89-ef6d-422d-a44d-8e822d6c16ee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Nov 08 17:44:57.263192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 588/1150] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:57.300896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-363acde8-3293-4d40-9eec-0eab22fccbff tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec353d30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:57.347301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-363acde8-3293-4d40-9eec-0eab22fccbff tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050162 Nov 08 17:44:57.348629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 563/1151] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:57 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:57.406879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-570ced79-812b-4e3d-9dfa-9bf665990318 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:57.407785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-570ced79-812b-4e3d-9dfa-9bf665990318 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:57.413473 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-570ced79-812b-4e3d-9dfa-9bf665990318 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:57.419654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-570ced79-812b-4e3d-9dfa-9bf665990318 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:57.419654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-570ced79-812b-4e3d-9dfa-9bf665990318 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:57.419654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-570ced79-812b-4e3d-9dfa-9bf665990318 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:57.444031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-570ced79-812b-4e3d-9dfa-9bf665990318 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040816 Nov 08 17:44:57.444581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 589/1152] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:58.274330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-893ac04b-c094-4587-9b26-99149755bbf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:58.275191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-893ac04b-c094-4587-9b26-99149755bbf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:58.281726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-893ac04b-c094-4587-9b26-99149755bbf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:58.282175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-893ac04b-c094-4587-9b26-99149755bbf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:58.283004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-893ac04b-c094-4587-9b26-99149755bbf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:58.283431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-893ac04b-c094-4587-9b26-99149755bbf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:58.311788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-893ac04b-c094-4587-9b26-99149755bbf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041825 Nov 08 17:44:58.312418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 564/1153] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:58.359273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3b0a7222-9a62-407e-a6b1-c6143ee03a86 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b2670>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:58.404822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3b0a7222-9a62-407e-a6b1-c6143ee03a86 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049045 Nov 08 17:44:58.405385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 590/1154] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:58 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:44:58.456079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-03fe0dd5-11f0-4500-8edd-d7837d1fc8b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:58.456852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-03fe0dd5-11f0-4500-8edd-d7837d1fc8b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:58.463375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03fe0dd5-11f0-4500-8edd-d7837d1fc8b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:58.463819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03fe0dd5-11f0-4500-8edd-d7837d1fc8b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:58.464587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03fe0dd5-11f0-4500-8edd-d7837d1fc8b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:58.465017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03fe0dd5-11f0-4500-8edd-d7837d1fc8b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:58.494047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-03fe0dd5-11f0-4500-8edd-d7837d1fc8b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041748 Nov 08 17:44:58.494629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 565/1155] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:44:59.323826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2063ddc3-37ae-47a7-8236-b9ef24ac568c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:59.324641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2063ddc3-37ae-47a7-8236-b9ef24ac568c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:59.331165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2063ddc3-37ae-47a7-8236-b9ef24ac568c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:59.331609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2063ddc3-37ae-47a7-8236-b9ef24ac568c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:59.332365 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2063ddc3-37ae-47a7-8236-b9ef24ac568c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:59.332789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2063ddc3-37ae-47a7-8236-b9ef24ac568c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:59.360882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2063ddc3-37ae-47a7-8236-b9ef24ac568c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Nov 08 17:44:59.361502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 591/1156] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:44:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:59.416675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-65e241f2-a9d9-4fcb-86d7-5da54f232fed tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ba4c0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:59.462071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-65e241f2-a9d9-4fcb-86d7-5da54f232fed tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048901 Nov 08 17:44:59.462661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 566/1157] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:44:59 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:44:59.504938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f9afa9af-369b-4b44-89ec-3665726995a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:44:59.505840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f9afa9af-369b-4b44-89ec-3665726995a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:44:59.512698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9afa9af-369b-4b44-89ec-3665726995a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:59.513142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9afa9af-369b-4b44-89ec-3665726995a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:59.513914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9afa9af-369b-4b44-89ec-3665726995a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:44:59.514341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9afa9af-369b-4b44-89ec-3665726995a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:44:59.543230 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f9afa9af-369b-4b44-89ec-3665726995a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042031 Nov 08 17:44:59.544095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 592/1158] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:44:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:00.373148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-26e546e2-dc90-49cf-b830-bf38ce959f98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:00.374065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-26e546e2-dc90-49cf-b830-bf38ce959f98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:00.380765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26e546e2-dc90-49cf-b830-bf38ce959f98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:00.381209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26e546e2-dc90-49cf-b830-bf38ce959f98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:00.381985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26e546e2-dc90-49cf-b830-bf38ce959f98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:00.382417 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26e546e2-dc90-49cf-b830-bf38ce959f98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:00.410872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-26e546e2-dc90-49cf-b830-bf38ce959f98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041489 Nov 08 17:45:00.411448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 567/1159] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:00.474237 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-92f3bba2-b314-462d-b05f-6c5a1344c129 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c5820>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:00.524209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-92f3bba2-b314-462d-b05f-6c5a1344c129 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053545 Nov 08 17:45:00.529332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 593/1160] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:00 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:00.553839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a9ea1f53-ea6b-4efa-a2ba-ab40d1c3c89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:00.555702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a9ea1f53-ea6b-4efa-a2ba-ab40d1c3c89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:00.562754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9ea1f53-ea6b-4efa-a2ba-ab40d1c3c89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:00.563212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9ea1f53-ea6b-4efa-a2ba-ab40d1c3c89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:00.565118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9ea1f53-ea6b-4efa-a2ba-ab40d1c3c89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:00.565118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9ea1f53-ea6b-4efa-a2ba-ab40d1c3c89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:00.597750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a9ea1f53-ea6b-4efa-a2ba-ab40d1c3c89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047273 Nov 08 17:45:00.598479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 568/1161] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:01.424971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3075e918-e802-4f94-b364-1f8b6ad48581 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:01.425874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3075e918-e802-4f94-b364-1f8b6ad48581 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:01.432455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3075e918-e802-4f94-b364-1f8b6ad48581 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:01.432930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3075e918-e802-4f94-b364-1f8b6ad48581 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:01.433691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3075e918-e802-4f94-b364-1f8b6ad48581 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:01.434118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3075e918-e802-4f94-b364-1f8b6ad48581 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:01.461557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3075e918-e802-4f94-b364-1f8b6ad48581 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040388 Nov 08 17:45:01.462094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 594/1162] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:01.536814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-19e7dfe5-e5cb-441d-bad5-20bd649d6089 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37c3a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:01.581593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-19e7dfe5-e5cb-441d-bad5-20bd649d6089 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048332 Nov 08 17:45:01.586952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 569/1163] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:01 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:01.609790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-48f49859-db85-4e9b-9131-c3b56006729f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:01.614170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-48f49859-db85-4e9b-9131-c3b56006729f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:01.617668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-48f49859-db85-4e9b-9131-c3b56006729f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:01.618104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-48f49859-db85-4e9b-9131-c3b56006729f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:01.618891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-48f49859-db85-4e9b-9131-c3b56006729f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:01.619307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-48f49859-db85-4e9b-9131-c3b56006729f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:01.652629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-48f49859-db85-4e9b-9131-c3b56006729f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046631 Nov 08 17:45:01.653195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 595/1164] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:02.472765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9d08e96c-49a0-4de8-b0a8-4cf0c31eb49e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:02.473664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9d08e96c-49a0-4de8-b0a8-4cf0c31eb49e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:02.480153 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d08e96c-49a0-4de8-b0a8-4cf0c31eb49e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:02.480595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d08e96c-49a0-4de8-b0a8-4cf0c31eb49e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:02.481353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d08e96c-49a0-4de8-b0a8-4cf0c31eb49e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:02.481774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d08e96c-49a0-4de8-b0a8-4cf0c31eb49e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:02.510709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9d08e96c-49a0-4de8-b0a8-4cf0c31eb49e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041616 Nov 08 17:45:02.511261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 570/1165] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:02.593276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-198e4fd2-1aa3-443b-b4b9-518056ed1e61 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec213430>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:02.638056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-198e4fd2-1aa3-443b-b4b9-518056ed1e61 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048315 Nov 08 17:45:02.638868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 596/1166] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:02 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:02.664084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-18cb76d1-135e-43ec-b207-21d46e9fd2e7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:02.665182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-18cb76d1-135e-43ec-b207-21d46e9fd2e7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:02.671335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18cb76d1-135e-43ec-b207-21d46e9fd2e7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:02.671779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18cb76d1-135e-43ec-b207-21d46e9fd2e7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:02.672776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18cb76d1-135e-43ec-b207-21d46e9fd2e7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:02.673456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-18cb76d1-135e-43ec-b207-21d46e9fd2e7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:02.703398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-18cb76d1-135e-43ec-b207-21d46e9fd2e7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043108 Nov 08 17:45:02.703952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 571/1167] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:03.520982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a22c50b2-5f80-4d26-b91c-288646bb716b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:03.521908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a22c50b2-5f80-4d26-b91c-288646bb716b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:03.528152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a22c50b2-5f80-4d26-b91c-288646bb716b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:03.528595 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a22c50b2-5f80-4d26-b91c-288646bb716b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:03.529358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a22c50b2-5f80-4d26-b91c-288646bb716b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:03.529786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a22c50b2-5f80-4d26-b91c-288646bb716b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:03.559252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a22c50b2-5f80-4d26-b91c-288646bb716b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041980 Nov 08 17:45:03.559790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 597/1168] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:03.650680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a053b761-ce8f-4126-ad4f-b4de04800673 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec37c5e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:03.694517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a053b761-ce8f-4126-ad4f-b4de04800673 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048050 Nov 08 17:45:03.695351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 572/1169] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:03 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:03.714568 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f1a06e55-b9ee-4064-856e-b71af3857811 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:03.715472 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f1a06e55-b9ee-4064-856e-b71af3857811 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:03.721608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f1a06e55-b9ee-4064-856e-b71af3857811 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:03.722055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f1a06e55-b9ee-4064-856e-b71af3857811 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:03.722846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f1a06e55-b9ee-4064-856e-b71af3857811 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:03.723277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f1a06e55-b9ee-4064-856e-b71af3857811 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:03.754651 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f1a06e55-b9ee-4064-856e-b71af3857811 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 Nov 08 17:45:03.755205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 598/1170] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:04.571296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1e9d4ebf-173e-49cf-9e8f-ec9b2a96e0c7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:04.572212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1e9d4ebf-173e-49cf-9e8f-ec9b2a96e0c7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:04.578795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e9d4ebf-173e-49cf-9e8f-ec9b2a96e0c7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:04.579244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e9d4ebf-173e-49cf-9e8f-ec9b2a96e0c7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:04.580012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e9d4ebf-173e-49cf-9e8f-ec9b2a96e0c7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:04.580443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e9d4ebf-173e-49cf-9e8f-ec9b2a96e0c7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:04.608068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1e9d4ebf-173e-49cf-9e8f-ec9b2a96e0c7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 Nov 08 17:45:04.608621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 573/1171] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:04.706637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4237675e-dc9a-4b67-a902-e81a6a9cb318 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:04.753736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4237675e-dc9a-4b67-a902-e81a6a9cb318 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050621 Nov 08 17:45:04.754587 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 599/1172] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:04 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:04.766267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-555acc1f-8288-4589-94d1-3ad1c0b69d4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:04.767292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-555acc1f-8288-4589-94d1-3ad1c0b69d4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:04.773578 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-555acc1f-8288-4589-94d1-3ad1c0b69d4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:04.774057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-555acc1f-8288-4589-94d1-3ad1c0b69d4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:04.774891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-555acc1f-8288-4589-94d1-3ad1c0b69d4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:04.775324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-555acc1f-8288-4589-94d1-3ad1c0b69d4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:04.807648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-555acc1f-8288-4589-94d1-3ad1c0b69d4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045249 Nov 08 17:45:04.808207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 574/1173] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:05.619896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-21a37332-5813-4384-aec0-4239d842f431 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:05.620795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-21a37332-5813-4384-aec0-4239d842f431 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:05.627309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-21a37332-5813-4384-aec0-4239d842f431 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:05.627755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-21a37332-5813-4384-aec0-4239d842f431 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:05.628518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-21a37332-5813-4384-aec0-4239d842f431 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:05.628945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-21a37332-5813-4384-aec0-4239d842f431 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:05.659993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-21a37332-5813-4384-aec0-4239d842f431 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Nov 08 17:45:05.660554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 600/1174] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:05.766613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4eea69a3-4b5a-45c7-a1bc-58fcea348244 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2a1ca0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:05.814374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4eea69a3-4b5a-45c7-a1bc-58fcea348244 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051030 Nov 08 17:45:05.819180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 575/1175] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:05 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:05.819341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5a6dd9a7-f4fb-4da9-83ef-9b693a1554bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:05.819813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5a6dd9a7-f4fb-4da9-83ef-9b693a1554bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:05.826936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5a6dd9a7-f4fb-4da9-83ef-9b693a1554bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:05.829791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5a6dd9a7-f4fb-4da9-83ef-9b693a1554bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:05.829791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5a6dd9a7-f4fb-4da9-83ef-9b693a1554bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:05.829791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5a6dd9a7-f4fb-4da9-83ef-9b693a1554bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:05.858946 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5a6dd9a7-f4fb-4da9-83ef-9b693a1554bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043698 Nov 08 17:45:05.862492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 601/1176] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:06.671504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ef02e221-7bfd-470d-a813-6ff643e0b050 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:06.672439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ef02e221-7bfd-470d-a813-6ff643e0b050 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:06.679057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef02e221-7bfd-470d-a813-6ff643e0b050 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:06.679507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef02e221-7bfd-470d-a813-6ff643e0b050 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:06.680281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef02e221-7bfd-470d-a813-6ff643e0b050 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:06.681203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef02e221-7bfd-470d-a813-6ff643e0b050 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:06.709655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ef02e221-7bfd-470d-a813-6ff643e0b050 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Nov 08 17:45:06.710214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 576/1177] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:06.827227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fef1154d-1c0d-4c7e-89e4-8cc78255ee9b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2091f0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:06.870047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e6fcc528-38dd-4b96-8d39-746d03a14001 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:06.871126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e6fcc528-38dd-4b96-8d39-746d03a14001 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:06.873601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fef1154d-1c0d-4c7e-89e4-8cc78255ee9b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050010 Nov 08 17:45:06.874487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 602/1178] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:06 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:06.877657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e6fcc528-38dd-4b96-8d39-746d03a14001 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:06.878097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e6fcc528-38dd-4b96-8d39-746d03a14001 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:06.878916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e6fcc528-38dd-4b96-8d39-746d03a14001 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:06.879326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e6fcc528-38dd-4b96-8d39-746d03a14001 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:06.909378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e6fcc528-38dd-4b96-8d39-746d03a14001 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043944 Nov 08 17:45:06.910084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 577/1179] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:07.721086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-83d372ef-0089-4430-a028-5e572efa4e69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:07.721982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-83d372ef-0089-4430-a028-5e572efa4e69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:07.729112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83d372ef-0089-4430-a028-5e572efa4e69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:07.729552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83d372ef-0089-4430-a028-5e572efa4e69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:07.730304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83d372ef-0089-4430-a028-5e572efa4e69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:07.730753 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83d372ef-0089-4430-a028-5e572efa4e69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:07.758531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-83d372ef-0089-4430-a028-5e572efa4e69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041216 Nov 08 17:45:07.759066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 603/1180] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:07.885713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e24fd93d-aa95-4589-847e-40c531030d2a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:07.921232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fc43da55-e7b8-4db9-b1b0-01c7b6f55c15 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:07.922164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fc43da55-e7b8-4db9-b1b0-01c7b6f55c15 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:07.928388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc43da55-e7b8-4db9-b1b0-01c7b6f55c15 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:07.928826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc43da55-e7b8-4db9-b1b0-01c7b6f55c15 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:07.931205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e24fd93d-aa95-4589-847e-40c531030d2a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049040 Nov 08 17:45:07.932629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 578/1181] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:07 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:07.933292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc43da55-e7b8-4db9-b1b0-01c7b6f55c15 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:07.933861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc43da55-e7b8-4db9-b1b0-01c7b6f55c15 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:07.963845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fc43da55-e7b8-4db9-b1b0-01c7b6f55c15 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046080 Nov 08 17:45:07.964662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 604/1182] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:45:08.769530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-213f083b-cf56-4a97-8331-a2fbc616bd3f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:08.770350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-213f083b-cf56-4a97-8331-a2fbc616bd3f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:08.777182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-213f083b-cf56-4a97-8331-a2fbc616bd3f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:08.777619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-213f083b-cf56-4a97-8331-a2fbc616bd3f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:08.778379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-213f083b-cf56-4a97-8331-a2fbc616bd3f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:08.778827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-213f083b-cf56-4a97-8331-a2fbc616bd3f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:08.806491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-213f083b-cf56-4a97-8331-a2fbc616bd3f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 Nov 08 17:45:08.807610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 579/1183] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:08.956483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5192cf04-0aa7-4c45-abf5-bf164cb6365e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b6d30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:08.975966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6a298e47-67bf-4b0f-adc9-871afe40f198 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:08.976871 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6a298e47-67bf-4b0f-adc9-871afe40f198 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:08.983895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a298e47-67bf-4b0f-adc9-871afe40f198 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:08.984341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a298e47-67bf-4b0f-adc9-871afe40f198 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:08.985143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a298e47-67bf-4b0f-adc9-871afe40f198 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:08.985585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a298e47-67bf-4b0f-adc9-871afe40f198 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:09.014046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5192cf04-0aa7-4c45-abf5-bf164cb6365e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.055304 Nov 08 17:45:09.014046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 605/1184] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:08 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:09.019905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6a298e47-67bf-4b0f-adc9-871afe40f198 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047802 Nov 08 17:45:09.020426 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 580/1185] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:09.818284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0bf66217-8018-4504-bc00-aa2726aa0588 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:09.819199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0bf66217-8018-4504-bc00-aa2726aa0588 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:09.826368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0bf66217-8018-4504-bc00-aa2726aa0588 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:09.826831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0bf66217-8018-4504-bc00-aa2726aa0588 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:09.827593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0bf66217-8018-4504-bc00-aa2726aa0588 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:09.828021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0bf66217-8018-4504-bc00-aa2726aa0588 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:09.855716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0bf66217-8018-4504-bc00-aa2726aa0588 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041181 Nov 08 17:45:09.856254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 606/1186] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:10.019966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c111417c-1c4b-44a7-bf32-5ec9e7c53122 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c670>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:10.031321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c8d4c90f-b666-404f-8c11-a96999f1cdc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:10.032306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c8d4c90f-b666-404f-8c11-a96999f1cdc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:10.039091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c8d4c90f-b666-404f-8c11-a96999f1cdc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:10.039534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c8d4c90f-b666-404f-8c11-a96999f1cdc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:10.040294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c8d4c90f-b666-404f-8c11-a96999f1cdc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:10.040721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c8d4c90f-b666-404f-8c11-a96999f1cdc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:10.067585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c111417c-1c4b-44a7-bf32-5ec9e7c53122 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051167 Nov 08 17:45:10.068238 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 581/1187] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:10 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:10.071426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c8d4c90f-b666-404f-8c11-a96999f1cdc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043730 Nov 08 17:45:10.073085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 607/1188] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:45:10.867117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-05b86380-f1cc-42f1-8873-47b35443b4ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:10.868042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-05b86380-f1cc-42f1-8873-47b35443b4ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:10.873861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-05b86380-f1cc-42f1-8873-47b35443b4ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:10.874300 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-05b86380-f1cc-42f1-8873-47b35443b4ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:10.875086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-05b86380-f1cc-42f1-8873-47b35443b4ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:10.875516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-05b86380-f1cc-42f1-8873-47b35443b4ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:10.904374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-05b86380-f1cc-42f1-8873-47b35443b4ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041244 Nov 08 17:45:10.904918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 582/1189] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:11.079316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-352d7200-e7a4-4aca-8743-85060d3fc558 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec21f940>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:11.082796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-02e1828a-730c-489c-b58f-95c2dc11219a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:11.083696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-02e1828a-730c-489c-b58f-95c2dc11219a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:11.090678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02e1828a-730c-489c-b58f-95c2dc11219a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:11.091118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02e1828a-730c-489c-b58f-95c2dc11219a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:11.092476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02e1828a-730c-489c-b58f-95c2dc11219a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:11.092476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02e1828a-730c-489c-b58f-95c2dc11219a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:11.121422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-02e1828a-730c-489c-b58f-95c2dc11219a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042170 Nov 08 17:45:11.121936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 583/1190] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:45:11.127078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-352d7200-e7a4-4aca-8743-85060d3fc558 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051619 Nov 08 17:45:11.127798 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 608/1191] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:11 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:11.916493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5dfcfa74-d867-41ad-af43-b88e3804f499 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:11.917759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5dfcfa74-d867-41ad-af43-b88e3804f499 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:11.923657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa74-d867-41ad-af43-b88e3804f499 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:11.924105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa74-d867-41ad-af43-b88e3804f499 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:11.924937 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa74-d867-41ad-af43-b88e3804f499 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:11.925373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dfcfa74-d867-41ad-af43-b88e3804f499 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:11.954553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5dfcfa74-d867-41ad-af43-b88e3804f499 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Nov 08 17:45:11.955112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 584/1192] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:12.133239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f222d20f-a694-4bda-b3fd-1a0779c3206b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:12.134220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f222d20f-a694-4bda-b3fd-1a0779c3206b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:12.139146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7be3eda5-ce19-4d16-9fd0-b5adff254a70 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:12.140898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f222d20f-a694-4bda-b3fd-1a0779c3206b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:12.141349 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f222d20f-a694-4bda-b3fd-1a0779c3206b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:12.142110 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f222d20f-a694-4bda-b3fd-1a0779c3206b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:12.142561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f222d20f-a694-4bda-b3fd-1a0779c3206b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:12.173465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f222d20f-a694-4bda-b3fd-1a0779c3206b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044380 Nov 08 17:45:12.174048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 609/1193] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:12.186059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7be3eda5-ce19-4d16-9fd0-b5adff254a70 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050561 Nov 08 17:45:12.186660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 585/1194] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:12.966053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-635857fb-a193-48b6-9922-d41d511e08a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:12.967043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-635857fb-a193-48b6-9922-d41d511e08a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:12.972795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-635857fb-a193-48b6-9922-d41d511e08a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:12.973233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-635857fb-a193-48b6-9922-d41d511e08a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:12.973991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-635857fb-a193-48b6-9922-d41d511e08a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:12.974421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-635857fb-a193-48b6-9922-d41d511e08a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:13.004657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-635857fb-a193-48b6-9922-d41d511e08a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042487 Nov 08 17:45:13.005229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 610/1195] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:13.186040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-73ddfd0b-d42f-4901-899e-404073bbb2fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:13.186955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-73ddfd0b-d42f-4901-899e-404073bbb2fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:13.195194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73ddfd0b-d42f-4901-899e-404073bbb2fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:13.195649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73ddfd0b-d42f-4901-899e-404073bbb2fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:13.196501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73ddfd0b-d42f-4901-899e-404073bbb2fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:13.196933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73ddfd0b-d42f-4901-899e-404073bbb2fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:13.198430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-03838fbf-9abb-4407-a893-e3a504c52574 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c5e0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:13.225890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-73ddfd0b-d42f-4901-899e-404073bbb2fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044688 Nov 08 17:45:13.226485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 586/1196] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:13.245553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-03838fbf-9abb-4407-a893-e3a504c52574 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050934 Nov 08 17:45:13.246128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 611/1197] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:13 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:14.016574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-289e34d5-0796-4f83-80ef-5cddb24f0110 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:14.017474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-289e34d5-0796-4f83-80ef-5cddb24f0110 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:14.023374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-289e34d5-0796-4f83-80ef-5cddb24f0110 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:14.023813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-289e34d5-0796-4f83-80ef-5cddb24f0110 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:14.024575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-289e34d5-0796-4f83-80ef-5cddb24f0110 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:14.024999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-289e34d5-0796-4f83-80ef-5cddb24f0110 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:14.053168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-289e34d5-0796-4f83-80ef-5cddb24f0110 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040353 Nov 08 17:45:14.053707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 587/1198] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:14.237547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-69187aba-5cb2-41da-9b30-95e2d3b8047e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:14.238439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-69187aba-5cb2-41da-9b30-95e2d3b8047e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:14.245826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-69187aba-5cb2-41da-9b30-95e2d3b8047e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:14.246210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-69187aba-5cb2-41da-9b30-95e2d3b8047e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:14.246998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-69187aba-5cb2-41da-9b30-95e2d3b8047e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:14.247422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-69187aba-5cb2-41da-9b30-95e2d3b8047e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:14.257283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d1f8951e-d2f4-42b4-bcd2-bdf171ca8b60 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c01f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:14.276103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-69187aba-5cb2-41da-9b30-95e2d3b8047e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042561 Nov 08 17:45:14.276657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 612/1199] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:14.303968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d1f8951e-d2f4-42b4-bcd2-bdf171ca8b60 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050177 Nov 08 17:45:14.304566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 588/1200] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:14 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:15.064232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9c5bb642-8cd2-4277-8005-9f2fdf00c59b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:15.065132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9c5bb642-8cd2-4277-8005-9f2fdf00c59b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:15.070896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c5bb642-8cd2-4277-8005-9f2fdf00c59b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:15.071338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c5bb642-8cd2-4277-8005-9f2fdf00c59b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:15.072143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c5bb642-8cd2-4277-8005-9f2fdf00c59b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:15.072569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c5bb642-8cd2-4277-8005-9f2fdf00c59b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:15.100194 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9c5bb642-8cd2-4277-8005-9f2fdf00c59b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039728 Nov 08 17:45:15.100743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 613/1201] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:15.288302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ea65f14b-5e36-4dd0-80df-87e30122e1a0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:15.289129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ea65f14b-5e36-4dd0-80df-87e30122e1a0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:15.295771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea65f14b-5e36-4dd0-80df-87e30122e1a0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:15.296214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea65f14b-5e36-4dd0-80df-87e30122e1a0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:15.296983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea65f14b-5e36-4dd0-80df-87e30122e1a0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:15.297415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea65f14b-5e36-4dd0-80df-87e30122e1a0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:15.316428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f31b83ba-6dd2-4b39-a3bb-a18f7e06e543 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b61f0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:15.326064 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ea65f14b-5e36-4dd0-80df-87e30122e1a0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042206 Nov 08 17:45:15.326642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 589/1202] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:15.362084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f31b83ba-6dd2-4b39-a3bb-a18f7e06e543 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049193 Nov 08 17:45:15.362675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 614/1203] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:15 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:16.112176 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0475290a-347f-43d2-b2c4-0f95c86e1cb5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:16.113069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0475290a-347f-43d2-b2c4-0f95c86e1cb5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:16.119713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0475290a-347f-43d2-b2c4-0f95c86e1cb5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:16.120151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0475290a-347f-43d2-b2c4-0f95c86e1cb5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:16.120906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0475290a-347f-43d2-b2c4-0f95c86e1cb5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:16.121331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0475290a-347f-43d2-b2c4-0f95c86e1cb5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:16.148379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0475290a-347f-43d2-b2c4-0f95c86e1cb5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039911 Nov 08 17:45:16.148912 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 590/1204] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:16.338070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ed97c82e-7430-4d23-8124-6f6f265034a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:16.338962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ed97c82e-7430-4d23-8124-6f6f265034a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:16.345519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed97c82e-7430-4d23-8124-6f6f265034a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:16.346003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed97c82e-7430-4d23-8124-6f6f265034a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:16.346811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed97c82e-7430-4d23-8124-6f6f265034a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:16.347242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ed97c82e-7430-4d23-8124-6f6f265034a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:16.374383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-45556b26-9946-45e1-a759-16a9d7fb2746 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:16.375907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ed97c82e-7430-4d23-8124-6f6f265034a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042581 Nov 08 17:45:16.376466 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 615/1205] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:16.420216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-45556b26-9946-45e1-a759-16a9d7fb2746 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049323 Nov 08 17:45:16.420773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 591/1206] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:16 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:17.159860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4f5c86b3-5287-4401-9c9b-49d87ddc6514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:17.160787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4f5c86b3-5287-4401-9c9b-49d87ddc6514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:17.166643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f5c86b3-5287-4401-9c9b-49d87ddc6514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:17.167085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f5c86b3-5287-4401-9c9b-49d87ddc6514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:17.167871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f5c86b3-5287-4401-9c9b-49d87ddc6514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:17.168299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f5c86b3-5287-4401-9c9b-49d87ddc6514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:17.195993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4f5c86b3-5287-4401-9c9b-49d87ddc6514 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039915 Nov 08 17:45:17.196530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 616/1207] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:17.388860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8c57bb6f-126b-4761-96c3-b98ce7d81615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:17.389766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8c57bb6f-126b-4761-96c3-b98ce7d81615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:17.396395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c57bb6f-126b-4761-96c3-b98ce7d81615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:17.396841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c57bb6f-126b-4761-96c3-b98ce7d81615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:17.397615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c57bb6f-126b-4761-96c3-b98ce7d81615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:17.398056 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c57bb6f-126b-4761-96c3-b98ce7d81615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:17.427437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8c57bb6f-126b-4761-96c3-b98ce7d81615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043939 Nov 08 17:45:17.427984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 592/1208] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:17.432818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3ddd528b-4fcb-45ae-94c3-ea758b3c0289 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec209f70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:17.478822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3ddd528b-4fcb-45ae-94c3-ea758b3c0289 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049322 Nov 08 17:45:17.479485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 617/1209] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:17 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:18.300655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6f11136b-4e44-4303-b4b8-cbc24d569397 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:18.301617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6f11136b-4e44-4303-b4b8-cbc24d569397 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:18.308025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f11136b-4e44-4303-b4b8-cbc24d569397 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:18.308473 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f11136b-4e44-4303-b4b8-cbc24d569397 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:18.309244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f11136b-4e44-4303-b4b8-cbc24d569397 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:18.309674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f11136b-4e44-4303-b4b8-cbc24d569397 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:18.337286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6f11136b-4e44-4303-b4b8-cbc24d569397 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133921 Nov 08 17:45:18.338206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 593/1210] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:18.439686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d243adef-a754-4a41-a2cf-341205b4f615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:18.440580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d243adef-a754-4a41-a2cf-341205b4f615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:18.447467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d243adef-a754-4a41-a2cf-341205b4f615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:18.447909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d243adef-a754-4a41-a2cf-341205b4f615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:18.448666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d243adef-a754-4a41-a2cf-341205b4f615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:18.449091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d243adef-a754-4a41-a2cf-341205b4f615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:18.476128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d243adef-a754-4a41-a2cf-341205b4f615 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040128 Nov 08 17:45:18.476626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 618/1211] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:45:18.490969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8bc1d643-5e3a-4b05-9693-c86c89e25a36 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24b4c0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:18.537287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8bc1d643-5e3a-4b05-9693-c86c89e25a36 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050058 Nov 08 17:45:18.537920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 594/1212] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:18 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:19.349149 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-63f8b60a-28f5-49b5-9b45-8c209e7b97b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:19.350229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-63f8b60a-28f5-49b5-9b45-8c209e7b97b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:19.356518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63f8b60a-28f5-49b5-9b45-8c209e7b97b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:19.356975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63f8b60a-28f5-49b5-9b45-8c209e7b97b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:19.357740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63f8b60a-28f5-49b5-9b45-8c209e7b97b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:19.358193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63f8b60a-28f5-49b5-9b45-8c209e7b97b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:19.388621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-63f8b60a-28f5-49b5-9b45-8c209e7b97b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Nov 08 17:45:19.389171 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 619/1213] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:19.487947 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9cc719a0-ead2-4229-b71f-a6876404fc83 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:19.488889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9cc719a0-ead2-4229-b71f-a6876404fc83 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:19.496624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cc719a0-ead2-4229-b71f-a6876404fc83 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:19.497206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cc719a0-ead2-4229-b71f-a6876404fc83 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:19.497838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cc719a0-ead2-4229-b71f-a6876404fc83 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:19.498278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cc719a0-ead2-4229-b71f-a6876404fc83 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:19.527761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9cc719a0-ead2-4229-b71f-a6876404fc83 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043617 Nov 08 17:45:19.528317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 595/1214] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:19.549716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d7605098-2376-4e0d-8c4d-5107c8ad9492 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec213af0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:19.599913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d7605098-2376-4e0d-8c4d-5107c8ad9492 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053648 Nov 08 17:45:19.600448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 620/1215] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:19 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:20.399275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f1c4098c-a94b-4d2b-8671-ee93e706b4a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:20.400749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f1c4098c-a94b-4d2b-8671-ee93e706b4a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:20.406624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1c4098c-a94b-4d2b-8671-ee93e706b4a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:20.407076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1c4098c-a94b-4d2b-8671-ee93e706b4a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:20.407841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1c4098c-a94b-4d2b-8671-ee93e706b4a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:20.408275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1c4098c-a94b-4d2b-8671-ee93e706b4a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:20.437323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f1c4098c-a94b-4d2b-8671-ee93e706b4a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041761 Nov 08 17:45:20.444194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 596/1216] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:20.539201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-83b18623-86fa-4436-8456-02d67525ee1f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:20.540209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-83b18623-86fa-4436-8456-02d67525ee1f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:20.546120 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83b18623-86fa-4436-8456-02d67525ee1f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:20.546592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83b18623-86fa-4436-8456-02d67525ee1f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:20.547344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83b18623-86fa-4436-8456-02d67525ee1f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:20.547765 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83b18623-86fa-4436-8456-02d67525ee1f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:20.576597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-83b18623-86fa-4436-8456-02d67525ee1f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041179 Nov 08 17:45:20.577244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 621/1217] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:20.611299 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9455a92f-ab71-4684-99f6-9f6bb6c65d9a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2515e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:20.657013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9455a92f-ab71-4684-99f6-9f6bb6c65d9a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049282 Nov 08 17:45:20.657585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 597/1218] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:20 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:21.453631 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-417ba06d-cbf3-4c9f-b92a-f00a0c49842d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:21.454559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-417ba06d-cbf3-4c9f-b92a-f00a0c49842d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:21.460325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-417ba06d-cbf3-4c9f-b92a-f00a0c49842d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:21.460766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-417ba06d-cbf3-4c9f-b92a-f00a0c49842d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:21.461529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-417ba06d-cbf3-4c9f-b92a-f00a0c49842d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:21.461963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-417ba06d-cbf3-4c9f-b92a-f00a0c49842d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:21.489971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-417ba06d-cbf3-4c9f-b92a-f00a0c49842d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040103 Nov 08 17:45:21.490801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 622/1219] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:21.589335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5c318e9e-513c-4080-9693-a5c5898a7b67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:21.590238 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5c318e9e-513c-4080-9693-a5c5898a7b67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:21.596811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c318e9e-513c-4080-9693-a5c5898a7b67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:21.597259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c318e9e-513c-4080-9693-a5c5898a7b67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:21.598024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c318e9e-513c-4080-9693-a5c5898a7b67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:21.598455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c318e9e-513c-4080-9693-a5c5898a7b67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:21.628536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5c318e9e-513c-4080-9693-a5c5898a7b67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043981 Nov 08 17:45:21.629204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 598/1220] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:21.669239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-79e413eb-2786-40be-9982-719c6f77651d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec209160>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:21.713910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-79e413eb-2786-40be-9982-719c6f77651d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048923 Nov 08 17:45:21.714492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 623/1221] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:21 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:22.501295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f8694afc-730a-4a79-8250-12d06894a430 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:22.502212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f8694afc-730a-4a79-8250-12d06894a430 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:22.507977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8694afc-730a-4a79-8250-12d06894a430 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:22.508415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8694afc-730a-4a79-8250-12d06894a430 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:22.509171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8694afc-730a-4a79-8250-12d06894a430 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:22.510223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8694afc-730a-4a79-8250-12d06894a430 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:22.537857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f8694afc-730a-4a79-8250-12d06894a430 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040325 Nov 08 17:45:22.538400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 599/1222] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:22.640655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c6b3f9f1-9fa3-4f27-b77b-0d2593e6c761 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:22.641567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c6b3f9f1-9fa3-4f27-b77b-0d2593e6c761 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:22.648167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6b3f9f1-9fa3-4f27-b77b-0d2593e6c761 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:22.648612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6b3f9f1-9fa3-4f27-b77b-0d2593e6c761 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:22.649378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6b3f9f1-9fa3-4f27-b77b-0d2593e6c761 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:22.649845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6b3f9f1-9fa3-4f27-b77b-0d2593e6c761 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:22.677585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c6b3f9f1-9fa3-4f27-b77b-0d2593e6c761 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040743 Nov 08 17:45:22.678323 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 624/1223] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:22.725815 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f91796f1-0cae-48ae-bbad-747b27e82c02 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2db430>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:22.771687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f91796f1-0cae-48ae-bbad-747b27e82c02 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049414 Nov 08 17:45:22.772260 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 600/1224] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:22 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:23.548260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f268ab0d-f0b3-4846-b86a-0dceee2c39a4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:23.549211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f268ab0d-f0b3-4846-b86a-0dceee2c39a4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:23.555386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f268ab0d-f0b3-4846-b86a-0dceee2c39a4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:23.555825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f268ab0d-f0b3-4846-b86a-0dceee2c39a4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:23.556584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f268ab0d-f0b3-4846-b86a-0dceee2c39a4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:23.557009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f268ab0d-f0b3-4846-b86a-0dceee2c39a4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:23.585242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f268ab0d-f0b3-4846-b86a-0dceee2c39a4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040730 Nov 08 17:45:23.585787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 625/1225] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:23.688922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ebda1504-53f7-41f8-8ae9-415e09c39953 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:23.689811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ebda1504-53f7-41f8-8ae9-415e09c39953 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:23.696356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebda1504-53f7-41f8-8ae9-415e09c39953 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:23.697361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebda1504-53f7-41f8-8ae9-415e09c39953 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:23.698117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebda1504-53f7-41f8-8ae9-415e09c39953 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:23.698564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebda1504-53f7-41f8-8ae9-415e09c39953 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:23.726079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ebda1504-53f7-41f8-8ae9-415e09c39953 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040883 Nov 08 17:45:23.726722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 601/1226] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:23.783778 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c0902beb-b8a8-4fc0-8cbf-86abb525e20f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373550>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:23.828551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c0902beb-b8a8-4fc0-8cbf-86abb525e20f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048144 Nov 08 17:45:23.829140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 626/1227] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:23 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:24.597231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d6cf0387-c87e-4728-a241-de5f043cdd4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:24.598155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d6cf0387-c87e-4728-a241-de5f043cdd4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:24.604554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6cf0387-c87e-4728-a241-de5f043cdd4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:24.605015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6cf0387-c87e-4728-a241-de5f043cdd4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:24.605777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6cf0387-c87e-4728-a241-de5f043cdd4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:24.606204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6cf0387-c87e-4728-a241-de5f043cdd4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:24.635601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d6cf0387-c87e-4728-a241-de5f043cdd4d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 Nov 08 17:45:24.636138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 602/1228] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:24.738146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-108208a4-7a09-4de6-8369-12b7ea8cbf10 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:24.739082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-108208a4-7a09-4de6-8369-12b7ea8cbf10 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:24.747008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-108208a4-7a09-4de6-8369-12b7ea8cbf10 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:24.747585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-108208a4-7a09-4de6-8369-12b7ea8cbf10 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:24.748370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-108208a4-7a09-4de6-8369-12b7ea8cbf10 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:24.748805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-108208a4-7a09-4de6-8369-12b7ea8cbf10 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:24.778508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-108208a4-7a09-4de6-8369-12b7ea8cbf10 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044617 Nov 08 17:45:24.778991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 627/1229] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:24.841166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c17a044e-07a5-4050-9e59-beece337b986 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2510d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:24.885539 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c17a044e-07a5-4050-9e59-beece337b986 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048611 Nov 08 17:45:24.886102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 603/1230] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:24 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:25.646712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ab540d7c-0c55-4173-bbe0-9d4af4d63a39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:25.647621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ab540d7c-0c55-4173-bbe0-9d4af4d63a39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:25.653979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ab540d7c-0c55-4173-bbe0-9d4af4d63a39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:25.654427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ab540d7c-0c55-4173-bbe0-9d4af4d63a39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:25.655228 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ab540d7c-0c55-4173-bbe0-9d4af4d63a39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:25.655656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ab540d7c-0c55-4173-bbe0-9d4af4d63a39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:25.684947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ab540d7c-0c55-4173-bbe0-9d4af4d63a39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042196 Nov 08 17:45:25.685564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 628/1231] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:25.789713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a4d170dc-18c4-47c3-b101-3290f72ae4c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:25.791329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a4d170dc-18c4-47c3-b101-3290f72ae4c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:25.798103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4d170dc-18c4-47c3-b101-3290f72ae4c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:25.798570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4d170dc-18c4-47c3-b101-3290f72ae4c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:25.799338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4d170dc-18c4-47c3-b101-3290f72ae4c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:25.799763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4d170dc-18c4-47c3-b101-3290f72ae4c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:25.829771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a4d170dc-18c4-47c3-b101-3290f72ae4c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044336 Nov 08 17:45:25.830327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 604/1232] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:25.896932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0120ec20-280b-4353-a5aa-1f322e528344 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c1040>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:25.942642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0120ec20-280b-4353-a5aa-1f322e528344 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049213 Nov 08 17:45:25.943144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 629/1233] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:25 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:26.695517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-51d5b987-685b-4706-8f1b-83878a73ce5f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:26.696569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-51d5b987-685b-4706-8f1b-83878a73ce5f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:26.702482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51d5b987-685b-4706-8f1b-83878a73ce5f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:26.702938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51d5b987-685b-4706-8f1b-83878a73ce5f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:26.703732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51d5b987-685b-4706-8f1b-83878a73ce5f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:26.704159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-51d5b987-685b-4706-8f1b-83878a73ce5f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:26.732262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-51d5b987-685b-4706-8f1b-83878a73ce5f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Nov 08 17:45:26.732810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 605/1234] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:26.841853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d8b3833e-02e7-43e1-9275-705e588923c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:26.842704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d8b3833e-02e7-43e1-9275-705e588923c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:26.849243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d8b3833e-02e7-43e1-9275-705e588923c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:26.849683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d8b3833e-02e7-43e1-9275-705e588923c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:26.850442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d8b3833e-02e7-43e1-9275-705e588923c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:26.850891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d8b3833e-02e7-43e1-9275-705e588923c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:26.879707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d8b3833e-02e7-43e1-9275-705e588923c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042308 Nov 08 17:45:26.880253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 630/1235] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:26.954585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-78618dfe-8307-4e9a-a5c6-2b9f3aeee11c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3a61f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:27.003305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-78618dfe-8307-4e9a-a5c6-2b9f3aeee11c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052199 Nov 08 17:45:27.003873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 606/1236] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:26 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:27.744282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-34d9fa67-c169-4920-bb5b-7a5bf2a698a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:27.745173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-34d9fa67-c169-4920-bb5b-7a5bf2a698a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:27.751397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34d9fa67-c169-4920-bb5b-7a5bf2a698a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:27.751836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34d9fa67-c169-4920-bb5b-7a5bf2a698a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:27.752696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34d9fa67-c169-4920-bb5b-7a5bf2a698a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:27.753129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34d9fa67-c169-4920-bb5b-7a5bf2a698a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:27.783063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-34d9fa67-c169-4920-bb5b-7a5bf2a698a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043306 Nov 08 17:45:27.783603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 631/1237] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:27.891279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-44eff978-8fc9-4984-85e3-26aa928afa80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:27.892177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-44eff978-8fc9-4984-85e3-26aa928afa80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:27.898764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44eff978-8fc9-4984-85e3-26aa928afa80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:27.899208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44eff978-8fc9-4984-85e3-26aa928afa80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:27.900043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44eff978-8fc9-4984-85e3-26aa928afa80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:27.900474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44eff978-8fc9-4984-85e3-26aa928afa80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:27.928036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-44eff978-8fc9-4984-85e3-26aa928afa80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040560 Nov 08 17:45:27.928575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 607/1238] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:28.015452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-54d7fd7d-4c83-4177-b8fd-5df47c8b751f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c15e0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:28.060435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-54d7fd7d-4c83-4177-b8fd-5df47c8b751f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048563 Nov 08 17:45:28.061006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 632/1239] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:28 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:28.794331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c88c7bdc-d1df-4c80-8c1d-d68981b40ff4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:28.795186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c88c7bdc-d1df-4c80-8c1d-d68981b40ff4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:28.801336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c88c7bdc-d1df-4c80-8c1d-d68981b40ff4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:28.801775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c88c7bdc-d1df-4c80-8c1d-d68981b40ff4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:28.802561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c88c7bdc-d1df-4c80-8c1d-d68981b40ff4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:28.802991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c88c7bdc-d1df-4c80-8c1d-d68981b40ff4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:28.830968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c88c7bdc-d1df-4c80-8c1d-d68981b40ff4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040458 Nov 08 17:45:28.831505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 608/1240] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:28.940284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1625f89a-f6d2-4c46-831f-08fe3171edd2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:28.941174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1625f89a-f6d2-4c46-831f-08fe3171edd2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:28.947623 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1625f89a-f6d2-4c46-831f-08fe3171edd2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:28.948068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1625f89a-f6d2-4c46-831f-08fe3171edd2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:28.948834 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1625f89a-f6d2-4c46-831f-08fe3171edd2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:28.949260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1625f89a-f6d2-4c46-831f-08fe3171edd2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:28.978003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1625f89a-f6d2-4c46-831f-08fe3171edd2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041835 Nov 08 17:45:28.978593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 633/1241] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:29.073534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a0ab56b3-3716-4e61-9d9b-5668050c61a7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec263160>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:29.119246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a0ab56b3-3716-4e61-9d9b-5668050c61a7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049426 Nov 08 17:45:29.119881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 609/1242] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:29 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:29.842788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-83e0cb5e-ad17-46d9-82ae-4d6a80da191b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:29.843689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-83e0cb5e-ad17-46d9-82ae-4d6a80da191b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:29.850003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83e0cb5e-ad17-46d9-82ae-4d6a80da191b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:29.850443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83e0cb5e-ad17-46d9-82ae-4d6a80da191b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:29.851214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83e0cb5e-ad17-46d9-82ae-4d6a80da191b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:29.851637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83e0cb5e-ad17-46d9-82ae-4d6a80da191b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:29.880222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-83e0cb5e-ad17-46d9-82ae-4d6a80da191b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 Nov 08 17:45:29.880766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 634/1243] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:29.989659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-adb186f3-f576-4b08-bc36-2a87a832a248 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:29.990942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-adb186f3-f576-4b08-bc36-2a87a832a248 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:29.998090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-adb186f3-f576-4b08-bc36-2a87a832a248 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:29.998572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-adb186f3-f576-4b08-bc36-2a87a832a248 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:29.999359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-adb186f3-f576-4b08-bc36-2a87a832a248 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:29.999791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-adb186f3-f576-4b08-bc36-2a87a832a248 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:30.027964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-adb186f3-f576-4b08-bc36-2a87a832a248 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042502 Nov 08 17:45:30.028519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 610/1244] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:30.131366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b33af786-a4dc-48ec-8535-a93009795d9e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c1280>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:30.177247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b33af786-a4dc-48ec-8535-a93009795d9e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049376 Nov 08 17:45:30.177811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 635/1245] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:30 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:30.891517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-057fbd7d-f102-46e8-b9ac-9190ab831f6a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:30.892456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-057fbd7d-f102-46e8-b9ac-9190ab831f6a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:30.898257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-057fbd7d-f102-46e8-b9ac-9190ab831f6a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:30.898729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-057fbd7d-f102-46e8-b9ac-9190ab831f6a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:30.900029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-057fbd7d-f102-46e8-b9ac-9190ab831f6a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:30.900546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-057fbd7d-f102-46e8-b9ac-9190ab831f6a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:30.928465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-057fbd7d-f102-46e8-b9ac-9190ab831f6a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040701 Nov 08 17:45:30.929013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 611/1246] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:31.039033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ca6a5a32-633d-464d-ad1d-6af89669fe28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:31.039919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ca6a5a32-633d-464d-ad1d-6af89669fe28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:31.046729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca6a5a32-633d-464d-ad1d-6af89669fe28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:31.047180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca6a5a32-633d-464d-ad1d-6af89669fe28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:31.047954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca6a5a32-633d-464d-ad1d-6af89669fe28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:31.048387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca6a5a32-633d-464d-ad1d-6af89669fe28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:31.076343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ca6a5a32-633d-464d-ad1d-6af89669fe28 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041122 Nov 08 17:45:31.076903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 636/1247] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:31.189294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4a1fb61a-bb30-48e4-9a85-eb19dd1cd681 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ba700>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:31.234734 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4a1fb61a-bb30-48e4-9a85-eb19dd1cd681 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048992 Nov 08 17:45:31.235327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 612/1248] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:31 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:31.940027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0641ebe5-ca3e-46c2-bc0d-fefc8f4904bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:31.940936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0641ebe5-ca3e-46c2-bc0d-fefc8f4904bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:31.947627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0641ebe5-ca3e-46c2-bc0d-fefc8f4904bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:31.948073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0641ebe5-ca3e-46c2-bc0d-fefc8f4904bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:31.948845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0641ebe5-ca3e-46c2-bc0d-fefc8f4904bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:31.949278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0641ebe5-ca3e-46c2-bc0d-fefc8f4904bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:31.977344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0641ebe5-ca3e-46c2-bc0d-fefc8f4904bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Nov 08 17:45:31.978745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 637/1249] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:32.088197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5d9d0d62-50ab-43a2-863a-082543994af4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:32.089090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5d9d0d62-50ab-43a2-863a-082543994af4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:32.095576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d9d0d62-50ab-43a2-863a-082543994af4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:32.096017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d9d0d62-50ab-43a2-863a-082543994af4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:32.096776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d9d0d62-50ab-43a2-863a-082543994af4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:32.097203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d9d0d62-50ab-43a2-863a-082543994af4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:32.125035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5d9d0d62-50ab-43a2-863a-082543994af4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041158 Nov 08 17:45:32.125571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 613/1250] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:32.247936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-167c5878-d377-47c3-89de-ab54735d5543 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec29e4c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:32.293155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-167c5878-d377-47c3-89de-ab54735d5543 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048852 Nov 08 17:45:32.293790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 638/1251] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:32 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:32.989379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-de6319f2-f0d6-465a-8f43-4117bd16c7df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:32.990556 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-de6319f2-f0d6-465a-8f43-4117bd16c7df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:32.996969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de6319f2-f0d6-465a-8f43-4117bd16c7df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:32.997456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de6319f2-f0d6-465a-8f43-4117bd16c7df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:32.998229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de6319f2-f0d6-465a-8f43-4117bd16c7df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:32.998681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de6319f2-f0d6-465a-8f43-4117bd16c7df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:33.027252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-de6319f2-f0d6-465a-8f43-4117bd16c7df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041647 Nov 08 17:45:33.027796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 614/1252] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:33.137667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1eb95d79-fdf9-4985-ad19-5abd2f2b0b53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:33.138614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1eb95d79-fdf9-4985-ad19-5abd2f2b0b53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:33.145222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1eb95d79-fdf9-4985-ad19-5abd2f2b0b53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:33.145602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1eb95d79-fdf9-4985-ad19-5abd2f2b0b53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:33.146358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1eb95d79-fdf9-4985-ad19-5abd2f2b0b53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:33.146809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1eb95d79-fdf9-4985-ad19-5abd2f2b0b53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:33.175086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1eb95d79-fdf9-4985-ad19-5abd2f2b0b53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042413 Nov 08 17:45:33.175630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 639/1253] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:33.304855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d8b6625e-4487-4120-bc25-fea6844ecee1 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec279430>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:33.350225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d8b6625e-4487-4120-bc25-fea6844ecee1 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048998 Nov 08 17:45:33.350838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 615/1254] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:33 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:34.038952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b67b4962-d58a-42ff-9e85-464a77311bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:34.039863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b67b4962-d58a-42ff-9e85-464a77311bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:34.046172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b67b4962-d58a-42ff-9e85-464a77311bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:34.046658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b67b4962-d58a-42ff-9e85-464a77311bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:34.047428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b67b4962-d58a-42ff-9e85-464a77311bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:34.047871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b67b4962-d58a-42ff-9e85-464a77311bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:34.076660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b67b4962-d58a-42ff-9e85-464a77311bde tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041630 Nov 08 17:45:34.077208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 640/1255] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:34.187634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a9a40ee2-b4bf-476a-a130-6234467b4140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:34.188547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a9a40ee2-b4bf-476a-a130-6234467b4140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:34.195268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9a40ee2-b4bf-476a-a130-6234467b4140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:34.195714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9a40ee2-b4bf-476a-a130-6234467b4140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:34.196537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9a40ee2-b4bf-476a-a130-6234467b4140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:34.197013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9a40ee2-b4bf-476a-a130-6234467b4140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:34.225453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a9a40ee2-b4bf-476a-a130-6234467b4140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042214 Nov 08 17:45:34.226004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 616/1256] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:45:34.362997 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-84f00962-106d-47fb-9ce0-d9e6080eb322 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b2550>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:34.408036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-84f00962-106d-47fb-9ce0-d9e6080eb322 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048674 Nov 08 17:45:34.408605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 641/1257] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:34 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:35.088677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-103c0342-10e3-487e-bc2b-dcf71633e6a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:35.089603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-103c0342-10e3-487e-bc2b-dcf71633e6a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:35.095452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-103c0342-10e3-487e-bc2b-dcf71633e6a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:35.095897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-103c0342-10e3-487e-bc2b-dcf71633e6a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:35.096660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-103c0342-10e3-487e-bc2b-dcf71633e6a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:35.097122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-103c0342-10e3-487e-bc2b-dcf71633e6a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:35.125372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-103c0342-10e3-487e-bc2b-dcf71633e6a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041136 Nov 08 17:45:35.125917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 617/1258] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:35.237021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-487bda26-e8e5-4dc2-888a-9e9a63e6ced2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:35.237920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-487bda26-e8e5-4dc2-888a-9e9a63e6ced2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:35.245352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-487bda26-e8e5-4dc2-888a-9e9a63e6ced2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:35.245732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-487bda26-e8e5-4dc2-888a-9e9a63e6ced2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:35.246520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-487bda26-e8e5-4dc2-888a-9e9a63e6ced2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:35.246957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-487bda26-e8e5-4dc2-888a-9e9a63e6ced2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:35.274734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-487bda26-e8e5-4dc2-888a-9e9a63e6ced2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041496 Nov 08 17:45:35.275302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 642/1259] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:35.420088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-11bb1398-4d67-4e14-8dee-bfcd0536ad3c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3845e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:35.465482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-11bb1398-4d67-4e14-8dee-bfcd0536ad3c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048927 Nov 08 17:45:35.466052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 618/1260] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:35 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:36.136715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-02f089f2-f3c5-40c0-b346-aa9a63a96c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:36.137628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-02f089f2-f3c5-40c0-b346-aa9a63a96c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:36.144062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02f089f2-f3c5-40c0-b346-aa9a63a96c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:36.144526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02f089f2-f3c5-40c0-b346-aa9a63a96c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:36.145308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02f089f2-f3c5-40c0-b346-aa9a63a96c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:36.145746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02f089f2-f3c5-40c0-b346-aa9a63a96c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:36.177468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-02f089f2-f3c5-40c0-b346-aa9a63a96c29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045027 Nov 08 17:45:36.178041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 643/1261] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:36.286290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b6ef8eb3-e3cd-43a6-9f5e-70faada60755 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:36.287212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b6ef8eb3-e3cd-43a6-9f5e-70faada60755 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:36.293943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6ef8eb3-e3cd-43a6-9f5e-70faada60755 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:36.294385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6ef8eb3-e3cd-43a6-9f5e-70faada60755 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:36.295172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6ef8eb3-e3cd-43a6-9f5e-70faada60755 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:36.295605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6ef8eb3-e3cd-43a6-9f5e-70faada60755 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:36.323244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b6ef8eb3-e3cd-43a6-9f5e-70faada60755 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040830 Nov 08 17:45:36.323784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 619/1262] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:45:36.476860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-58ade590-d01f-41f9-be39-be5a5b3a9e1f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec29ed30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:36.521784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-58ade590-d01f-41f9-be39-be5a5b3a9e1f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048570 Nov 08 17:45:36.522588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 644/1263] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:36 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:37.188410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c49eac28-d23b-4b20-884b-fdf944cefdf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:37.189302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c49eac28-d23b-4b20-884b-fdf944cefdf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:37.195141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c49eac28-d23b-4b20-884b-fdf944cefdf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:37.195580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c49eac28-d23b-4b20-884b-fdf944cefdf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:37.197025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c49eac28-d23b-4b20-884b-fdf944cefdf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:37.197453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c49eac28-d23b-4b20-884b-fdf944cefdf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:37.225234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c49eac28-d23b-4b20-884b-fdf944cefdf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040723 Nov 08 17:45:37.225782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 620/1264] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:37.335497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c0f9bc9b-f1a9-4392-9370-febbb35e7175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:37.336306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c0f9bc9b-f1a9-4392-9370-febbb35e7175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:37.342915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0f9bc9b-f1a9-4392-9370-febbb35e7175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:37.343354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0f9bc9b-f1a9-4392-9370-febbb35e7175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:37.344110 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0f9bc9b-f1a9-4392-9370-febbb35e7175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:37.344531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0f9bc9b-f1a9-4392-9370-febbb35e7175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:37.373536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c0f9bc9b-f1a9-4392-9370-febbb35e7175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042400 Nov 08 17:45:37.374083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 645/1265] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:37.535077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7ea2fbd9-8baa-4822-9830-f797fd993d47 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25cd30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:37.579292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7ea2fbd9-8baa-4822-9830-f797fd993d47 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047757 Nov 08 17:45:37.579848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 621/1266] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:37 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:38.236532 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-47c865b5-57e7-4938-85d5-445d64c2b9ad tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:38.237450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-47c865b5-57e7-4938-85d5-445d64c2b9ad tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:38.243602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47c865b5-57e7-4938-85d5-445d64c2b9ad tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:38.244030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47c865b5-57e7-4938-85d5-445d64c2b9ad tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:38.244791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47c865b5-57e7-4938-85d5-445d64c2b9ad tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:38.245216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47c865b5-57e7-4938-85d5-445d64c2b9ad tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:38.272559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-47c865b5-57e7-4938-85d5-445d64c2b9ad tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039935 Nov 08 17:45:38.273105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 646/1267] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:38.385092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bf144cc3-f9cf-4f38-8c5f-6617873d4c80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:38.385988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bf144cc3-f9cf-4f38-8c5f-6617873d4c80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:38.392480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bf144cc3-f9cf-4f38-8c5f-6617873d4c80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:38.392920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bf144cc3-f9cf-4f38-8c5f-6617873d4c80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:38.393685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bf144cc3-f9cf-4f38-8c5f-6617873d4c80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:38.394114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bf144cc3-f9cf-4f38-8c5f-6617873d4c80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:38.422404 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bf144cc3-f9cf-4f38-8c5f-6617873d4c80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041816 Nov 08 17:45:38.422983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 622/1268] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:38.591910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2924d0bd-b3e2-48f8-bcc5-3cc38b00b4e8 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec378160>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:38.636604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2924d0bd-b3e2-48f8-bcc5-3cc38b00b4e8 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048246 Nov 08 17:45:38.637169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 647/1269] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:38 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:39.284498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7cc487aa-eca2-49fb-85f0-8a9852727e5b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:39.285326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7cc487aa-eca2-49fb-85f0-8a9852727e5b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:39.291677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7cc487aa-eca2-49fb-85f0-8a9852727e5b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:39.292135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7cc487aa-eca2-49fb-85f0-8a9852727e5b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:39.292903 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7cc487aa-eca2-49fb-85f0-8a9852727e5b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:39.293338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7cc487aa-eca2-49fb-85f0-8a9852727e5b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:39.322264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7cc487aa-eca2-49fb-85f0-8a9852727e5b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040649 Nov 08 17:45:39.322843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 623/1270] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:39.434569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2d03bc73-0c99-40bd-9dc2-d67c44d00909 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:39.435461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2d03bc73-0c99-40bd-9dc2-d67c44d00909 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:39.441950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2d03bc73-0c99-40bd-9dc2-d67c44d00909 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:39.442389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2d03bc73-0c99-40bd-9dc2-d67c44d00909 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:39.443187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2d03bc73-0c99-40bd-9dc2-d67c44d00909 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:39.443616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2d03bc73-0c99-40bd-9dc2-d67c44d00909 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:39.472260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2d03bc73-0c99-40bd-9dc2-d67c44d00909 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041953 Nov 08 17:45:39.472802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 648/1271] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:39.648570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f2ebbcd-6ee6-4079-952a-483087337e18 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f700>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:39.693938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5f2ebbcd-6ee6-4079-952a-483087337e18 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048917 Nov 08 17:45:39.694562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 624/1272] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:39 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:40.333833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-96e6796f-cf5e-4449-939c-df05c1096e64 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:40.334712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-96e6796f-cf5e-4449-939c-df05c1096e64 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:40.341070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-96e6796f-cf5e-4449-939c-df05c1096e64 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:40.341510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-96e6796f-cf5e-4449-939c-df05c1096e64 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:40.342264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-96e6796f-cf5e-4449-939c-df05c1096e64 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:40.342710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-96e6796f-cf5e-4449-939c-df05c1096e64 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:40.370392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-96e6796f-cf5e-4449-939c-df05c1096e64 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040510 Nov 08 17:45:40.370965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 649/1273] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:40.483532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d5e0d81f-2164-4c2d-85ec-2c338e41e726 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:40.484530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d5e0d81f-2164-4c2d-85ec-2c338e41e726 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:40.491397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d5e0d81f-2164-4c2d-85ec-2c338e41e726 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:40.491839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d5e0d81f-2164-4c2d-85ec-2c338e41e726 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:40.492611 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d5e0d81f-2164-4c2d-85ec-2c338e41e726 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:40.493615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d5e0d81f-2164-4c2d-85ec-2c338e41e726 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:40.521957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d5e0d81f-2164-4c2d-85ec-2c338e41e726 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042212 Nov 08 17:45:40.522519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 625/1274] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:40.706892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4c936b09-40a1-417c-a49e-d41cc4a7d684 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2138b0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:40.753034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4c936b09-40a1-417c-a49e-d41cc4a7d684 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049660 Nov 08 17:45:40.753621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 650/1275] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:40 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:41.381659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-67cbcddc-fae2-40d6-af40-299553fc1e8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:41.382575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-67cbcddc-fae2-40d6-af40-299553fc1e8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:41.389624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67cbcddc-fae2-40d6-af40-299553fc1e8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:41.392897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67cbcddc-fae2-40d6-af40-299553fc1e8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:41.392897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67cbcddc-fae2-40d6-af40-299553fc1e8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:41.392897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67cbcddc-fae2-40d6-af40-299553fc1e8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:41.419029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-67cbcddc-fae2-40d6-af40-299553fc1e8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041183 Nov 08 17:45:41.419571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 626/1276] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:41.533015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d5056955-1d1c-4ae9-8cec-d8a6bd4af68c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:41.533913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d5056955-1d1c-4ae9-8cec-d8a6bd4af68c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:41.541301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5056955-1d1c-4ae9-8cec-d8a6bd4af68c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:41.541741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5056955-1d1c-4ae9-8cec-d8a6bd4af68c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:41.542532 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5056955-1d1c-4ae9-8cec-d8a6bd4af68c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:41.542963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5056955-1d1c-4ae9-8cec-d8a6bd4af68c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:41.571520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d5056955-1d1c-4ae9-8cec-d8a6bd4af68c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042189 Nov 08 17:45:41.572074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 651/1277] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:41.765028 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cb28f473-ea0d-4a53-8cf4-5cbebdfe055f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec279a60>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:41.809887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cb28f473-ea0d-4a53-8cf4-5cbebdfe055f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048582 Nov 08 17:45:41.810484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 627/1278] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:41 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:42.432488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cbe351cd-b0dc-4c2d-88dd-09332f4afad5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:42.433421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cbe351cd-b0dc-4c2d-88dd-09332f4afad5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:42.439846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cbe351cd-b0dc-4c2d-88dd-09332f4afad5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:42.440285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cbe351cd-b0dc-4c2d-88dd-09332f4afad5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:42.441045 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cbe351cd-b0dc-4c2d-88dd-09332f4afad5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:42.441475 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cbe351cd-b0dc-4c2d-88dd-09332f4afad5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:42.470336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cbe351cd-b0dc-4c2d-88dd-09332f4afad5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Nov 08 17:45:42.470906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 652/1279] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:42.583546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f785c3bc-16d3-4267-b797-ebafd8f876a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:42.584445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f785c3bc-16d3-4267-b797-ebafd8f876a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:42.591703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f785c3bc-16d3-4267-b797-ebafd8f876a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:42.592147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f785c3bc-16d3-4267-b797-ebafd8f876a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:42.592913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f785c3bc-16d3-4267-b797-ebafd8f876a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:42.593343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f785c3bc-16d3-4267-b797-ebafd8f876a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:42.623106 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f785c3bc-16d3-4267-b797-ebafd8f876a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043772 Nov 08 17:45:42.623652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 628/1280] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:45:42.822160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7988e46d-983b-4faf-97ac-f1baa7016fb6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec213d30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:42.866960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7988e46d-983b-4faf-97ac-f1baa7016fb6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048575 Nov 08 17:45:42.867528 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 653/1281] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:42 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:43.484986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2b7eb6fc-55cc-46fb-9265-d3f9e20a0c69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:43.485892 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2b7eb6fc-55cc-46fb-9265-d3f9e20a0c69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:43.491981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b7eb6fc-55cc-46fb-9265-d3f9e20a0c69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:43.492430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b7eb6fc-55cc-46fb-9265-d3f9e20a0c69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:43.493843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b7eb6fc-55cc-46fb-9265-d3f9e20a0c69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:43.494281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b7eb6fc-55cc-46fb-9265-d3f9e20a0c69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:43.522575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2b7eb6fc-55cc-46fb-9265-d3f9e20a0c69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041275 Nov 08 17:45:43.523118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 629/1282] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:43.635817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fd1c0d21-1700-4dfc-82b2-2102587d4353 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:43.636710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fd1c0d21-1700-4dfc-82b2-2102587d4353 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:43.643268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd1c0d21-1700-4dfc-82b2-2102587d4353 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:43.643739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd1c0d21-1700-4dfc-82b2-2102587d4353 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:43.644507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd1c0d21-1700-4dfc-82b2-2102587d4353 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:43.644964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd1c0d21-1700-4dfc-82b2-2102587d4353 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:43.674271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fd1c0d21-1700-4dfc-82b2-2102587d4353 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043452 Nov 08 17:45:43.674869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 654/1283] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:43.879135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-27320956-8dfe-4213-b025-4ae5afe8f446 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25ca60>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:43.925340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-27320956-8dfe-4213-b025-4ae5afe8f446 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049676 Nov 08 17:45:43.926026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 630/1284] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:43 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:44.533906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7c08dc6c-2fe8-404d-9d54-635bf7a4feba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:44.534823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7c08dc6c-2fe8-404d-9d54-635bf7a4feba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:44.540868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7c08dc6c-2fe8-404d-9d54-635bf7a4feba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:44.541319 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7c08dc6c-2fe8-404d-9d54-635bf7a4feba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:44.542063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7c08dc6c-2fe8-404d-9d54-635bf7a4feba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:44.542504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7c08dc6c-2fe8-404d-9d54-635bf7a4feba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:44.571772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7c08dc6c-2fe8-404d-9d54-635bf7a4feba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Nov 08 17:45:44.572311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 655/1285] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:44.685931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f78a1472-1b52-4c8b-9ff7-b0ee8a5c182e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:44.686855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f78a1472-1b52-4c8b-9ff7-b0ee8a5c182e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:44.693222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f78a1472-1b52-4c8b-9ff7-b0ee8a5c182e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:44.693673 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f78a1472-1b52-4c8b-9ff7-b0ee8a5c182e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:44.694443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f78a1472-1b52-4c8b-9ff7-b0ee8a5c182e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:44.694969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f78a1472-1b52-4c8b-9ff7-b0ee8a5c182e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:44.724286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f78a1472-1b52-4c8b-9ff7-b0ee8a5c182e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042064 Nov 08 17:45:44.724840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 631/1286] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:44.938166 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3a4204e1-d4f7-465b-b3d8-3f45fce95fc3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec6f40d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:44.984158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3a4204e1-d4f7-465b-b3d8-3f45fce95fc3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049533 Nov 08 17:45:44.984731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 656/1287] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:44 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:45.582974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6d74912a-3326-4666-af5d-2314174ea2a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:45.583874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6d74912a-3326-4666-af5d-2314174ea2a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:45.590142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d74912a-3326-4666-af5d-2314174ea2a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:45.590618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d74912a-3326-4666-af5d-2314174ea2a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:45.591379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d74912a-3326-4666-af5d-2314174ea2a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:45.591806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d74912a-3326-4666-af5d-2314174ea2a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:45.620301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6d74912a-3326-4666-af5d-2314174ea2a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 Nov 08 17:45:45.620842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 632/1288] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:45.736031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0a45b239-6804-4655-a977-5506107a6163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:45.736996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0a45b239-6804-4655-a977-5506107a6163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:45.743211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0a45b239-6804-4655-a977-5506107a6163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:45.743688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0a45b239-6804-4655-a977-5506107a6163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:45.745001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0a45b239-6804-4655-a977-5506107a6163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:45.745425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0a45b239-6804-4655-a977-5506107a6163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:45.774934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0a45b239-6804-4655-a977-5506107a6163 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042694 Nov 08 17:45:45.775509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 657/1289] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:45:45.997248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b9248edf-2178-46e6-8e76-ae25a39a2fd4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec279430>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:46.041329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b9248edf-2178-46e6-8e76-ae25a39a2fd4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048144 Nov 08 17:45:46.042092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 633/1290] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:45 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:46.631611 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-46ee0074-4bb2-4375-993a-288379fcf6b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:46.632516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-46ee0074-4bb2-4375-993a-288379fcf6b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:46.638820 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46ee0074-4bb2-4375-993a-288379fcf6b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:46.639261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46ee0074-4bb2-4375-993a-288379fcf6b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:46.640110 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46ee0074-4bb2-4375-993a-288379fcf6b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:46.640547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46ee0074-4bb2-4375-993a-288379fcf6b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:46.669214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-46ee0074-4bb2-4375-993a-288379fcf6b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041306 Nov 08 17:45:46.669758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 658/1291] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:46.786870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3832ce1e-7659-4555-a96a-93253a669169 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:46.787697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3832ce1e-7659-4555-a96a-93253a669169 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:46.794360 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3832ce1e-7659-4555-a96a-93253a669169 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:46.794835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3832ce1e-7659-4555-a96a-93253a669169 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:46.795609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3832ce1e-7659-4555-a96a-93253a669169 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:46.796041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3832ce1e-7659-4555-a96a-93253a669169 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:46.823901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3832ce1e-7659-4555-a96a-93253a669169 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041383 Nov 08 17:45:46.824452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 634/1292] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:47.055033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-895cbf7c-e683-4120-957f-7773243096ae tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c670>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:47.098369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-895cbf7c-e683-4120-957f-7773243096ae tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048770 Nov 08 17:45:47.098975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 659/1293] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:47 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:47.680498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dcb7afd6-d7de-441f-b244-5c31cb10d1b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:47.681457 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dcb7afd6-d7de-441f-b244-5c31cb10d1b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:47.687288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcb7afd6-d7de-441f-b244-5c31cb10d1b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:47.687724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcb7afd6-d7de-441f-b244-5c31cb10d1b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:47.688478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcb7afd6-d7de-441f-b244-5c31cb10d1b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:47.688901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcb7afd6-d7de-441f-b244-5c31cb10d1b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:47.717287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dcb7afd6-d7de-441f-b244-5c31cb10d1b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040544 Nov 08 17:45:47.717825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 635/1294] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:47.835722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e79488c7-9cd6-49fe-a0a2-9471af86c02c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:47.836599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e79488c7-9cd6-49fe-a0a2-9471af86c02c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:47.843724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e79488c7-9cd6-49fe-a0a2-9471af86c02c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:47.847743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e79488c7-9cd6-49fe-a0a2-9471af86c02c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:47.847743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e79488c7-9cd6-49fe-a0a2-9471af86c02c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:47.847743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e79488c7-9cd6-49fe-a0a2-9471af86c02c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:47.873093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e79488c7-9cd6-49fe-a0a2-9471af86c02c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041631 Nov 08 17:45:47.873640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 660/1295] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:48.109806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cdb680f9-1c35-4686-b8c6-a40047fbba0c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25ca60>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:48.155405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cdb680f9-1c35-4686-b8c6-a40047fbba0c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049078 Nov 08 17:45:48.155984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 636/1296] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:48 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:48.728988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-290049c4-d53c-4a65-b1cd-186efcc121ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:48.729932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-290049c4-d53c-4a65-b1cd-186efcc121ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:48.735859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-290049c4-d53c-4a65-b1cd-186efcc121ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:48.736309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-290049c4-d53c-4a65-b1cd-186efcc121ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:48.737075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-290049c4-d53c-4a65-b1cd-186efcc121ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:48.737508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-290049c4-d53c-4a65-b1cd-186efcc121ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:48.766292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-290049c4-d53c-4a65-b1cd-186efcc121ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 Nov 08 17:45:48.766859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 661/1297] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:48.884764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-36b3f28c-d3ca-4812-bd95-e9d4c6ac4df4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:48.885658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-36b3f28c-d3ca-4812-bd95-e9d4c6ac4df4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:48.892112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36b3f28c-d3ca-4812-bd95-e9d4c6ac4df4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:48.892550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36b3f28c-d3ca-4812-bd95-e9d4c6ac4df4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:48.893309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36b3f28c-d3ca-4812-bd95-e9d4c6ac4df4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:48.893733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36b3f28c-d3ca-4812-bd95-e9d4c6ac4df4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:48.921619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-36b3f28c-d3ca-4812-bd95-e9d4c6ac4df4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040827 Nov 08 17:45:48.922155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 637/1298] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:49.167657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ec382c76-b1ea-4a87-a225-3516dd6470ec tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec209f70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:49.211903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ec382c76-b1ea-4a87-a225-3516dd6470ec tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048461 Nov 08 17:45:49.212962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 662/1299] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:49 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:49.777724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-47c4cd48-8951-41b9-b4db-e3d74cb693a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:49.778658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-47c4cd48-8951-41b9-b4db-e3d74cb693a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:49.784822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-47c4cd48-8951-41b9-b4db-e3d74cb693a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:49.785262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-47c4cd48-8951-41b9-b4db-e3d74cb693a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:49.786022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-47c4cd48-8951-41b9-b4db-e3d74cb693a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:49.786450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-47c4cd48-8951-41b9-b4db-e3d74cb693a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:49.814950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-47c4cd48-8951-41b9-b4db-e3d74cb693a0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041167 Nov 08 17:45:49.815489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 638/1300] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:49.933530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8326c743-03ad-4914-b28b-edcbf1325f08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:49.934436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8326c743-03ad-4914-b28b-edcbf1325f08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:49.940938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8326c743-03ad-4914-b28b-edcbf1325f08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:49.941384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8326c743-03ad-4914-b28b-edcbf1325f08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:49.942152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8326c743-03ad-4914-b28b-edcbf1325f08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:49.942618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8326c743-03ad-4914-b28b-edcbf1325f08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:49.970356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8326c743-03ad-4914-b28b-edcbf1325f08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041431 Nov 08 17:45:49.970936 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 663/1301] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:50.223877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f1f44a3-48fd-469c-9bb3-de189a5ce10d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2290d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:50.268923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5f1f44a3-48fd-469c-9bb3-de189a5ce10d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048565 Nov 08 17:45:50.269486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 639/1302] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:50 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:50.827164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-db8a67f9-f2aa-4175-9d2c-a8e36693c744 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:50.828120 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-db8a67f9-f2aa-4175-9d2c-a8e36693c744 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:50.834276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-db8a67f9-f2aa-4175-9d2c-a8e36693c744 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:50.834756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-db8a67f9-f2aa-4175-9d2c-a8e36693c744 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:50.835536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-db8a67f9-f2aa-4175-9d2c-a8e36693c744 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:50.835969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-db8a67f9-f2aa-4175-9d2c-a8e36693c744 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:50.864299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-db8a67f9-f2aa-4175-9d2c-a8e36693c744 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041251 Nov 08 17:45:50.865114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 664/1303] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:50.982282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7d09d102-32cf-4da7-9c1f-289f27f35a82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:50.983289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7d09d102-32cf-4da7-9c1f-289f27f35a82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:50.991158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d09d102-32cf-4da7-9c1f-289f27f35a82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:50.991596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d09d102-32cf-4da7-9c1f-289f27f35a82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:50.992369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d09d102-32cf-4da7-9c1f-289f27f35a82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:50.992795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d09d102-32cf-4da7-9c1f-289f27f35a82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:51.021419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7d09d102-32cf-4da7-9c1f-289f27f35a82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044133 Nov 08 17:45:51.021977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 640/1304] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:51.281275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-65f6b14d-b9ad-4835-9636-3cdde531e167 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec21ff70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:51.327202 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-65f6b14d-b9ad-4835-9636-3cdde531e167 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049431 Nov 08 17:45:51.327766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 665/1305] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:51 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:51.875837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fb8aff94-bfdc-40ff-94d4-a88258bc2f3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:51.876744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fb8aff94-bfdc-40ff-94d4-a88258bc2f3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:51.882532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fb8aff94-bfdc-40ff-94d4-a88258bc2f3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:51.882970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fb8aff94-bfdc-40ff-94d4-a88258bc2f3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:51.883727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fb8aff94-bfdc-40ff-94d4-a88258bc2f3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:51.884704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fb8aff94-bfdc-40ff-94d4-a88258bc2f3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:51.912730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fb8aff94-bfdc-40ff-94d4-a88258bc2f3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040637 Nov 08 17:45:51.913273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 641/1306] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:52.033548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-45314c81-1646-429a-b0db-fc1d37f790aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:52.034492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-45314c81-1646-429a-b0db-fc1d37f790aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:52.041336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-45314c81-1646-429a-b0db-fc1d37f790aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:52.041805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-45314c81-1646-429a-b0db-fc1d37f790aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:52.042599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-45314c81-1646-429a-b0db-fc1d37f790aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:52.043038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-45314c81-1646-429a-b0db-fc1d37f790aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:52.071306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-45314c81-1646-429a-b0db-fc1d37f790aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041955 Nov 08 17:45:52.072693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 666/1307] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:52.348290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-746e5080-9c68-47fc-8bce-34ff1736193b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec251af0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:52.393335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-746e5080-9c68-47fc-8bce-34ff1736193b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048774 Nov 08 17:45:52.393928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 642/1308] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:52 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:52.923987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ead3a41d-b16d-46d8-a056-8f6009ca3f39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:52.924889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ead3a41d-b16d-46d8-a056-8f6009ca3f39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:52.930682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ead3a41d-b16d-46d8-a056-8f6009ca3f39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:52.931254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ead3a41d-b16d-46d8-a056-8f6009ca3f39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:52.932191 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ead3a41d-b16d-46d8-a056-8f6009ca3f39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:52.932630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ead3a41d-b16d-46d8-a056-8f6009ca3f39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:52.960990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ead3a41d-b16d-46d8-a056-8f6009ca3f39 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040723 Nov 08 17:45:52.961534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 667/1309] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:53.083537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5d39a586-9a29-4ce7-baaa-d266ee9dbea8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:53.084432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5d39a586-9a29-4ce7-baaa-d266ee9dbea8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:53.091668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d39a586-9a29-4ce7-baaa-d266ee9dbea8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:53.092108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d39a586-9a29-4ce7-baaa-d266ee9dbea8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:53.092869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d39a586-9a29-4ce7-baaa-d266ee9dbea8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:53.093298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d39a586-9a29-4ce7-baaa-d266ee9dbea8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:53.120761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5d39a586-9a29-4ce7-baaa-d266ee9dbea8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040931 Nov 08 17:45:53.121302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 643/1310] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:53.405483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bd8d732d-cf5d-4201-92ee-cb28a3532d40 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2af0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:53.451190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bd8d732d-cf5d-4201-92ee-cb28a3532d40 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049278 Nov 08 17:45:53.453104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 668/1311] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:53 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:53.972856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d9a11451-1984-414c-8c11-7dd8aa0a2be8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:53.973757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d9a11451-1984-414c-8c11-7dd8aa0a2be8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:53.980487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d9a11451-1984-414c-8c11-7dd8aa0a2be8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:53.980921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d9a11451-1984-414c-8c11-7dd8aa0a2be8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:53.981677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d9a11451-1984-414c-8c11-7dd8aa0a2be8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:53.982103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d9a11451-1984-414c-8c11-7dd8aa0a2be8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:54.011935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d9a11451-1984-414c-8c11-7dd8aa0a2be8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 Nov 08 17:45:54.012491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 644/1312] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:54.132087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ec768749-0c79-44c6-96e6-06f017a21a69 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:54.132984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ec768749-0c79-44c6-96e6-06f017a21a69 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:54.139109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ec768749-0c79-44c6-96e6-06f017a21a69 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:54.139590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ec768749-0c79-44c6-96e6-06f017a21a69 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:54.140357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ec768749-0c79-44c6-96e6-06f017a21a69 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:54.140784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ec768749-0c79-44c6-96e6-06f017a21a69 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:54.169457 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ec768749-0c79-44c6-96e6-06f017a21a69 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041116 Nov 08 17:45:54.170006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 669/1313] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:54.464543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a79fe37b-9a7e-4254-a51d-4b324e6bb2c0 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2ba8b0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:54.509507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a79fe37b-9a7e-4254-a51d-4b324e6bb2c0 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049067 Nov 08 17:45:54.510069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 645/1314] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:54 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:55.023350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8c04f0f3-34ad-42be-bf80-10cbfca06353 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:55.024262 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8c04f0f3-34ad-42be-bf80-10cbfca06353 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:55.030491 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8c04f0f3-34ad-42be-bf80-10cbfca06353 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:55.030930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8c04f0f3-34ad-42be-bf80-10cbfca06353 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:55.031693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8c04f0f3-34ad-42be-bf80-10cbfca06353 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:55.032119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8c04f0f3-34ad-42be-bf80-10cbfca06353 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:55.060890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8c04f0f3-34ad-42be-bf80-10cbfca06353 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041375 Nov 08 17:45:55.061447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 670/1315] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:55.181884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5e27207c-d164-4f2b-b66d-c42327657b5b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:55.183102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5e27207c-d164-4f2b-b66d-c42327657b5b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:55.189455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e27207c-d164-4f2b-b66d-c42327657b5b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:55.189890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e27207c-d164-4f2b-b66d-c42327657b5b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:55.190685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e27207c-d164-4f2b-b66d-c42327657b5b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:55.191113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e27207c-d164-4f2b-b66d-c42327657b5b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:55.219129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5e27207c-d164-4f2b-b66d-c42327657b5b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041979 Nov 08 17:45:55.219693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 646/1316] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:55.521921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ddb8ec3f-6dd4-44b0-a371-9a21a36231c3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec209670>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:55.569051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ddb8ec3f-6dd4-44b0-a371-9a21a36231c3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051275 Nov 08 17:45:55.569652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 671/1317] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:55 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:56.072804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c1789bf7-2434-40df-9909-f2161306deeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:56.073734 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c1789bf7-2434-40df-9909-f2161306deeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:56.079554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1789bf7-2434-40df-9909-f2161306deeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:56.079995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1789bf7-2434-40df-9909-f2161306deeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:56.080754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1789bf7-2434-40df-9909-f2161306deeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:56.081183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1789bf7-2434-40df-9909-f2161306deeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:56.109674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c1789bf7-2434-40df-9909-f2161306deeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041286 Nov 08 17:45:56.110210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 647/1318] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:56.231189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d88ff22a-2266-4927-9b4d-22ec87d3528e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:56.232078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d88ff22a-2266-4927-9b4d-22ec87d3528e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:56.238644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d88ff22a-2266-4927-9b4d-22ec87d3528e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:56.239089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d88ff22a-2266-4927-9b4d-22ec87d3528e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:56.240105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d88ff22a-2266-4927-9b4d-22ec87d3528e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:56.240530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d88ff22a-2266-4927-9b4d-22ec87d3528e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:56.268588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d88ff22a-2266-4927-9b4d-22ec87d3528e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042102 Nov 08 17:45:56.269063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 672/1319] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:56.581254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ae5960c3-3e10-4249-a0cd-6519d3825d9d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2baaf0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:56.627776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ae5960c3-3e10-4249-a0cd-6519d3825d9d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049995 Nov 08 17:45:56.628363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 648/1320] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:56 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:57.122013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ee77a7ad-bd0b-446c-a976-93afa61e27d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:57.122940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ee77a7ad-bd0b-446c-a976-93afa61e27d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:57.128726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee77a7ad-bd0b-446c-a976-93afa61e27d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:57.129172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee77a7ad-bd0b-446c-a976-93afa61e27d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:57.129970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee77a7ad-bd0b-446c-a976-93afa61e27d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:57.130402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee77a7ad-bd0b-446c-a976-93afa61e27d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:57.157717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ee77a7ad-bd0b-446c-a976-93afa61e27d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040403 Nov 08 17:45:57.158261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 673/1321] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:57.280882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d337dc46-588d-48b1-b0ca-d4e2f323c2c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:57.281714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d337dc46-588d-48b1-b0ca-d4e2f323c2c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:57.288273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d337dc46-588d-48b1-b0ca-d4e2f323c2c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:57.288718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d337dc46-588d-48b1-b0ca-d4e2f323c2c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:57.289512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d337dc46-588d-48b1-b0ca-d4e2f323c2c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:57.289930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d337dc46-588d-48b1-b0ca-d4e2f323c2c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:57.318351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d337dc46-588d-48b1-b0ca-d4e2f323c2c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041342 Nov 08 17:45:57.318920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 649/1322] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:57.640312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-95a438f3-1e59-47f4-9077-0e52442f8961 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b6c10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:57.692481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-95a438f3-1e59-47f4-9077-0e52442f8961 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.055735 Nov 08 17:45:57.693048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 674/1323] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:57 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:45:58.169104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8943b790-5047-4e23-b6f7-dcd0df1fb670 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:58.170032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8943b790-5047-4e23-b6f7-dcd0df1fb670 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:58.175961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8943b790-5047-4e23-b6f7-dcd0df1fb670 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:58.176404 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8943b790-5047-4e23-b6f7-dcd0df1fb670 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:58.177168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8943b790-5047-4e23-b6f7-dcd0df1fb670 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:58.177601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8943b790-5047-4e23-b6f7-dcd0df1fb670 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:58.209213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8943b790-5047-4e23-b6f7-dcd0df1fb670 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Nov 08 17:45:58.209847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 650/1324] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:58.329540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d592dcc3-7d79-4463-9c80-4ea0b73452a9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:58.330351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d592dcc3-7d79-4463-9c80-4ea0b73452a9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:58.336879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d592dcc3-7d79-4463-9c80-4ea0b73452a9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:58.337932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d592dcc3-7d79-4463-9c80-4ea0b73452a9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:58.338783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d592dcc3-7d79-4463-9c80-4ea0b73452a9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:58.339212 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d592dcc3-7d79-4463-9c80-4ea0b73452a9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:58.369904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d592dcc3-7d79-4463-9c80-4ea0b73452a9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044413 Nov 08 17:45:58.370453 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 675/1325] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:58.704684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6de1f2e5-eeff-4a93-ae65-5158d14abcc3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec22e790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:58.750348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6de1f2e5-eeff-4a93-ae65-5158d14abcc3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049256 Nov 08 17:45:58.750950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 651/1326] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:58 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:59.220625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5c7fbcfa-4dfe-4e25-b961-b3ce1a1612b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:59.221536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5c7fbcfa-4dfe-4e25-b961-b3ce1a1612b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:59.228356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c7fbcfa-4dfe-4e25-b961-b3ce1a1612b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:59.228799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c7fbcfa-4dfe-4e25-b961-b3ce1a1612b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:59.229562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c7fbcfa-4dfe-4e25-b961-b3ce1a1612b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:59.229995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c7fbcfa-4dfe-4e25-b961-b3ce1a1612b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:59.258621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5c7fbcfa-4dfe-4e25-b961-b3ce1a1612b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041717 Nov 08 17:45:59.259791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 676/1327] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:45:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:45:59.381631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-28ed8c1a-0b82-43d8-98eb-c1a7cdaaa1d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:59.382634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-28ed8c1a-0b82-43d8-98eb-c1a7cdaaa1d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:45:59.389145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-28ed8c1a-0b82-43d8-98eb-c1a7cdaaa1d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:59.389613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-28ed8c1a-0b82-43d8-98eb-c1a7cdaaa1d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:59.390379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-28ed8c1a-0b82-43d8-98eb-c1a7cdaaa1d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:45:59.390831 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-28ed8c1a-0b82-43d8-98eb-c1a7cdaaa1d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:45:59.419342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-28ed8c1a-0b82-43d8-98eb-c1a7cdaaa1d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041934 Nov 08 17:45:59.419894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 652/1328] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:45:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:45:59.762356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fa2bec72-b564-44ba-a5e8-2e2ade0cf72b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec209d30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:45:59.808998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fa2bec72-b564-44ba-a5e8-2e2ade0cf72b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050216 Nov 08 17:45:59.809566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 677/1329] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:45:59 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:00.270640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f8236cf-da98-4278-8967-485f926a5b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:00.271550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5f8236cf-da98-4278-8967-485f926a5b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:00.278088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f8236cf-da98-4278-8967-485f926a5b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:00.278586 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f8236cf-da98-4278-8967-485f926a5b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:00.279359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f8236cf-da98-4278-8967-485f926a5b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:00.279792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f8236cf-da98-4278-8967-485f926a5b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:00.307969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5f8236cf-da98-4278-8967-485f926a5b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Nov 08 17:46:00.308511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 653/1330] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:00.431719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cda58bf3-bdbb-4a56-bb9a-371106b45292 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:00.432634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cda58bf3-bdbb-4a56-bb9a-371106b45292 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:00.439373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cda58bf3-bdbb-4a56-bb9a-371106b45292 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:00.439816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cda58bf3-bdbb-4a56-bb9a-371106b45292 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:00.440595 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cda58bf3-bdbb-4a56-bb9a-371106b45292 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:00.441004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cda58bf3-bdbb-4a56-bb9a-371106b45292 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:00.469307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cda58bf3-bdbb-4a56-bb9a-371106b45292 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042140 Nov 08 17:46:00.469856 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 678/1331] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:00.820886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-24cd84a3-a970-4755-af95-f422e95bb014 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3845e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:00.865968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-24cd84a3-a970-4755-af95-f422e95bb014 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048739 Nov 08 17:46:00.866718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 654/1332] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:00 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:01.318402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6d516765-71a8-46af-be89-1c285e8178c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:01.319325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6d516765-71a8-46af-be89-1c285e8178c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:01.327335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d516765-71a8-46af-be89-1c285e8178c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:01.327933 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d516765-71a8-46af-be89-1c285e8178c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:01.328923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d516765-71a8-46af-be89-1c285e8178c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:01.329640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d516765-71a8-46af-be89-1c285e8178c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:01.366032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6d516765-71a8-46af-be89-1c285e8178c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051080 Nov 08 17:46:01.366624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 679/1333] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:01.480897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-861424e3-db54-44f9-9d14-95e875ed193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:01.481786 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-861424e3-db54-44f9-9d14-95e875ed193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:01.489682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-861424e3-db54-44f9-9d14-95e875ed193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:01.490115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-861424e3-db54-44f9-9d14-95e875ed193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:01.490899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-861424e3-db54-44f9-9d14-95e875ed193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:01.492003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-861424e3-db54-44f9-9d14-95e875ed193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:01.530054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-861424e3-db54-44f9-9d14-95e875ed193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052955 Nov 08 17:46:01.530650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 655/1334] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:01.879867 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d934543f-b405-4094-bbca-01fb8048b95b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2d30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:01.930105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d934543f-b405-4094-bbca-01fb8048b95b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.054794 Nov 08 17:46:01.930791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 680/1335] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:01 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:02.389977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ed96695e-999d-4cb8-8710-a4bbcfd70f82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:02.391028 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ed96695e-999d-4cb8-8710-a4bbcfd70f82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:02.397217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed96695e-999d-4cb8-8710-a4bbcfd70f82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:02.397659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed96695e-999d-4cb8-8710-a4bbcfd70f82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:02.398533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed96695e-999d-4cb8-8710-a4bbcfd70f82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:02.398962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed96695e-999d-4cb8-8710-a4bbcfd70f82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:02.427237 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ed96695e-999d-4cb8-8710-a4bbcfd70f82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041157 Nov 08 17:46:02.427783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 656/1336] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:02.542215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3e6af547-3df4-4f5d-ac6b-b5edbfae09cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:02.543153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3e6af547-3df4-4f5d-ac6b-b5edbfae09cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:02.549054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e6af547-3df4-4f5d-ac6b-b5edbfae09cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:02.549499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e6af547-3df4-4f5d-ac6b-b5edbfae09cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:02.550267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e6af547-3df4-4f5d-ac6b-b5edbfae09cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:02.550731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e6af547-3df4-4f5d-ac6b-b5edbfae09cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:02.578724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3e6af547-3df4-4f5d-ac6b-b5edbfae09cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040923 Nov 08 17:46:02.579272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 681/1337] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:02.942806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9ec76472-f341-4993-8989-61bc6503789c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3901f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:02.993472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9ec76472-f341-4993-8989-61bc6503789c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053850 Nov 08 17:46:02.993823 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 657/1338] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:02 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:03.439722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2dac3cb4-5f1d-47e4-b7cd-d3fd1925e68f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:03.440639 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2dac3cb4-5f1d-47e4-b7cd-d3fd1925e68f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:03.447745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2dac3cb4-5f1d-47e4-b7cd-d3fd1925e68f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:03.448189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2dac3cb4-5f1d-47e4-b7cd-d3fd1925e68f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:03.448963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2dac3cb4-5f1d-47e4-b7cd-d3fd1925e68f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:03.449396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2dac3cb4-5f1d-47e4-b7cd-d3fd1925e68f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:03.476899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2dac3cb4-5f1d-47e4-b7cd-d3fd1925e68f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040961 Nov 08 17:46:03.477447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 682/1339] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:03.590698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8f7cdbfd-b750-45c0-952f-0ec1664cadcb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:03.591582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8f7cdbfd-b750-45c0-952f-0ec1664cadcb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:03.598150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f7cdbfd-b750-45c0-952f-0ec1664cadcb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:03.598616 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f7cdbfd-b750-45c0-952f-0ec1664cadcb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:03.599375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f7cdbfd-b750-45c0-952f-0ec1664cadcb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:03.599796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f7cdbfd-b750-45c0-952f-0ec1664cadcb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:03.628816 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8f7cdbfd-b750-45c0-952f-0ec1664cadcb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042407 Nov 08 17:46:03.629365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 658/1340] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:04.004934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3ee7f4d9-e086-4ec6-a368-2f5aa5119153 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec21f3a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:04.050658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3ee7f4d9-e086-4ec6-a368-2f5aa5119153 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049206 Nov 08 17:46:04.057634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 683/1341] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:04 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:04.487471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ba68f29f-a8ea-482e-ba6c-374877ca8fc4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:04.488423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ba68f29f-a8ea-482e-ba6c-374877ca8fc4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:04.494889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba68f29f-a8ea-482e-ba6c-374877ca8fc4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:04.495332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba68f29f-a8ea-482e-ba6c-374877ca8fc4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:04.496097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba68f29f-a8ea-482e-ba6c-374877ca8fc4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:04.496536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba68f29f-a8ea-482e-ba6c-374877ca8fc4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:04.525252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ba68f29f-a8ea-482e-ba6c-374877ca8fc4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040804 Nov 08 17:46:04.525802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 659/1342] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:04.641231 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6b4260c0-7c17-463a-ad75-065c8b066ab8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:04.642124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6b4260c0-7c17-463a-ad75-065c8b066ab8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:04.648686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b4260c0-7c17-463a-ad75-065c8b066ab8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:04.649131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b4260c0-7c17-463a-ad75-065c8b066ab8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:04.650484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b4260c0-7c17-463a-ad75-065c8b066ab8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:04.650950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6b4260c0-7c17-463a-ad75-065c8b066ab8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:04.678114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6b4260c0-7c17-463a-ad75-065c8b066ab8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041245 Nov 08 17:46:04.678684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 684/1343] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:05.062918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7483e7b5-31d1-44cf-ba22-ee4f83b9aae3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2515e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:05.108557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7483e7b5-31d1-44cf-ba22-ee4f83b9aae3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049197 Nov 08 17:46:05.109114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 660/1344] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:05 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:05.535583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f0c3a5b9-a6a0-47f3-93a9-7f1dd97175fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:05.536510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f0c3a5b9-a6a0-47f3-93a9-7f1dd97175fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:05.542323 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0c3a5b9-a6a0-47f3-93a9-7f1dd97175fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:05.542792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0c3a5b9-a6a0-47f3-93a9-7f1dd97175fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:05.543548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0c3a5b9-a6a0-47f3-93a9-7f1dd97175fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:05.543977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0c3a5b9-a6a0-47f3-93a9-7f1dd97175fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:05.572550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f0c3a5b9-a6a0-47f3-93a9-7f1dd97175fd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040718 Nov 08 17:46:05.573086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 685/1345] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:05.690609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f2def21-bbfb-4f1b-abfe-575743306591 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:05.691501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5f2def21-bbfb-4f1b-abfe-575743306591 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:05.698837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f2def21-bbfb-4f1b-abfe-575743306591 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:05.699274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f2def21-bbfb-4f1b-abfe-575743306591 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:05.700031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f2def21-bbfb-4f1b-abfe-575743306591 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:05.700451 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f2def21-bbfb-4f1b-abfe-575743306591 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:05.729606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5f2def21-bbfb-4f1b-abfe-575743306591 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043086 Nov 08 17:46:05.730493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 661/1346] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:06.121294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-64630dd0-9a37-4cdf-af39-7676374c8077 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec23bee0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:06.168897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-64630dd0-9a37-4cdf-af39-7676374c8077 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051807 Nov 08 17:46:06.169474 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 686/1347] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:06 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:46:06.583664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-84da4cc9-41a5-4863-98a6-8fffecd6bba8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:06.584557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-84da4cc9-41a5-4863-98a6-8fffecd6bba8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:06.590806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-84da4cc9-41a5-4863-98a6-8fffecd6bba8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:06.591242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-84da4cc9-41a5-4863-98a6-8fffecd6bba8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:06.592000 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-84da4cc9-41a5-4863-98a6-8fffecd6bba8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:06.592424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-84da4cc9-41a5-4863-98a6-8fffecd6bba8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:06.626797 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-84da4cc9-41a5-4863-98a6-8fffecd6bba8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Nov 08 17:46:06.627351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 662/1348] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:06.740946 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0fd60c1e-d210-4d8a-a5a5-4a354896babb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:06.741856 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0fd60c1e-d210-4d8a-a5a5-4a354896babb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:06.748605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0fd60c1e-d210-4d8a-a5a5-4a354896babb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:06.749051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0fd60c1e-d210-4d8a-a5a5-4a354896babb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:06.749819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0fd60c1e-d210-4d8a-a5a5-4a354896babb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:06.750251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0fd60c1e-d210-4d8a-a5a5-4a354896babb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:06.778814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0fd60c1e-d210-4d8a-a5a5-4a354896babb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041943 Nov 08 17:46:06.779353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 687/1349] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:07.181070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-efb6523a-469c-4a20-a6a6-a4e75fe7adcf tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec384670>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:07.226755 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-efb6523a-469c-4a20-a6a6-a4e75fe7adcf tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049210 Nov 08 17:46:07.228007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 663/1350] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:07 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:07.638961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d2ecc6a7-df05-4a8e-8e8c-ca3271a635a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:07.639875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d2ecc6a7-df05-4a8e-8e8c-ca3271a635a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:07.646165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a7-df05-4a8e-8e8c-ca3271a635a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:07.646663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a7-df05-4a8e-8e8c-ca3271a635a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:07.647448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a7-df05-4a8e-8e8c-ca3271a635a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:07.647886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d2ecc6a7-df05-4a8e-8e8c-ca3271a635a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:07.677163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d2ecc6a7-df05-4a8e-8e8c-ca3271a635a9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 Nov 08 17:46:07.677717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 688/1351] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:07.790093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a3365a67-e131-4b39-954a-5d9232d22683 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:07.791108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a3365a67-e131-4b39-954a-5d9232d22683 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:07.796918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a3365a67-e131-4b39-954a-5d9232d22683 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:07.797360 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a3365a67-e131-4b39-954a-5d9232d22683 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:07.798115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a3365a67-e131-4b39-954a-5d9232d22683 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:07.798641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a3365a67-e131-4b39-954a-5d9232d22683 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:07.827395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a3365a67-e131-4b39-954a-5d9232d22683 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041049 Nov 08 17:46:07.827933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 664/1352] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:46:08.240160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-23e7c686-69eb-477a-a73f-85a2a903afe5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec21f310>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:08.285047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-23e7c686-69eb-477a-a73f-85a2a903afe5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048946 Nov 08 17:46:08.285624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 689/1353] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:08 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:08.688479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e51332ec-22b5-4872-b297-dc80af05e04c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:08.689375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e51332ec-22b5-4872-b297-dc80af05e04c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:08.695751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e51332ec-22b5-4872-b297-dc80af05e04c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:08.696858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e51332ec-22b5-4872-b297-dc80af05e04c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:08.697613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e51332ec-22b5-4872-b297-dc80af05e04c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:08.698035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e51332ec-22b5-4872-b297-dc80af05e04c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:08.725324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e51332ec-22b5-4872-b297-dc80af05e04c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040612 Nov 08 17:46:08.725868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 665/1354] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:08.840081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-651d1789-a71a-47ff-8363-0cb58297167a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:08.840941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-651d1789-a71a-47ff-8363-0cb58297167a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:08.846746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-651d1789-a71a-47ff-8363-0cb58297167a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:08.847186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-651d1789-a71a-47ff-8363-0cb58297167a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:08.847947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-651d1789-a71a-47ff-8363-0cb58297167a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:08.848371 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-651d1789-a71a-47ff-8363-0cb58297167a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:08.876985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-651d1789-a71a-47ff-8363-0cb58297167a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041407 Nov 08 17:46:08.877521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 690/1355] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:09.297721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bc8a7621-b626-4995-b422-94038e08f798 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec251310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:09.343459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bc8a7621-b626-4995-b422-94038e08f798 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049307 Nov 08 17:46:09.344078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 666/1356] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:09 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:09.736564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dbdd53c0-1960-486a-9958-57b39573b209 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:09.737465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dbdd53c0-1960-486a-9958-57b39573b209 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:09.744392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbdd53c0-1960-486a-9958-57b39573b209 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:09.744829 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbdd53c0-1960-486a-9958-57b39573b209 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:09.745597 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbdd53c0-1960-486a-9958-57b39573b209 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:09.746031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbdd53c0-1960-486a-9958-57b39573b209 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:09.774878 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dbdd53c0-1960-486a-9958-57b39573b209 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041852 Nov 08 17:46:09.775429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 691/1357] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:09.889055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6d92218e-a6f9-4706-b53a-83b4a853ef75 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:09.890051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6d92218e-a6f9-4706-b53a-83b4a853ef75 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:09.896488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d92218e-a6f9-4706-b53a-83b4a853ef75 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:09.896929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d92218e-a6f9-4706-b53a-83b4a853ef75 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:09.897703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d92218e-a6f9-4706-b53a-83b4a853ef75 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:09.898112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6d92218e-a6f9-4706-b53a-83b4a853ef75 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:09.925685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6d92218e-a6f9-4706-b53a-83b4a853ef75 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040838 Nov 08 17:46:09.926223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 667/1358] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:46:10.356151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-630d60be-6aec-4ca4-a3a1-b8894f8bb70e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373820>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:10.400360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-630d60be-6aec-4ca4-a3a1-b8894f8bb70e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048450 Nov 08 17:46:10.400938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 692/1359] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:10 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:10.786049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-35ebb4af-f86f-4e0a-9511-ac295437f996 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:10.786974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-35ebb4af-f86f-4e0a-9511-ac295437f996 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:10.793410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-35ebb4af-f86f-4e0a-9511-ac295437f996 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:10.793850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-35ebb4af-f86f-4e0a-9511-ac295437f996 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:10.794638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-35ebb4af-f86f-4e0a-9511-ac295437f996 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:10.795064 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-35ebb4af-f86f-4e0a-9511-ac295437f996 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:10.822869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-35ebb4af-f86f-4e0a-9511-ac295437f996 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040498 Nov 08 17:46:10.823410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 668/1360] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:10.937530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-135b6324-ef7a-451d-a372-57833612a3f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:10.938451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-135b6324-ef7a-451d-a372-57833612a3f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:10.944373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-135b6324-ef7a-451d-a372-57833612a3f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:10.944817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-135b6324-ef7a-451d-a372-57833612a3f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:10.945576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-135b6324-ef7a-451d-a372-57833612a3f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:10.946010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-135b6324-ef7a-451d-a372-57833612a3f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:10.974242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-135b6324-ef7a-451d-a372-57833612a3f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041064 Nov 08 17:46:10.974815 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 693/1361] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:11.412637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e8990b61-8657-4846-a1dc-1d3585c4741e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:11.458930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e8990b61-8657-4846-a1dc-1d3585c4741e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049866 Nov 08 17:46:11.459572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 669/1362] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:11 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:11.833679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4acd2542-ada7-4d77-aba4-aa90857a38d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:11.834522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4acd2542-ada7-4d77-aba4-aa90857a38d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:11.840280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4acd2542-ada7-4d77-aba4-aa90857a38d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:11.840721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4acd2542-ada7-4d77-aba4-aa90857a38d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:11.841483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4acd2542-ada7-4d77-aba4-aa90857a38d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:11.841909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4acd2542-ada7-4d77-aba4-aa90857a38d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:11.870240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4acd2542-ada7-4d77-aba4-aa90857a38d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040340 Nov 08 17:46:11.870811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 694/1363] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:11.985907 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aad4feb8-f11b-4947-8bb6-476ebac4675f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:11.986866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aad4feb8-f11b-4947-8bb6-476ebac4675f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:11.993870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aad4feb8-f11b-4947-8bb6-476ebac4675f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:11.994387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aad4feb8-f11b-4947-8bb6-476ebac4675f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:11.995203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aad4feb8-f11b-4947-8bb6-476ebac4675f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:11.995633 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aad4feb8-f11b-4947-8bb6-476ebac4675f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:12.023568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aad4feb8-f11b-4947-8bb6-476ebac4675f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041404 Nov 08 17:46:12.024122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 670/1364] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:12.471362 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5d8c1908-8b23-40f4-8640-bc6b40b554fd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec6f40d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:12.517446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5d8c1908-8b23-40f4-8640-bc6b40b554fd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049622 Nov 08 17:46:12.518075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 695/1365] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:12.881487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5a8e0f72-1a87-46ca-9aef-2c5a31b95201 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:12.882437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5a8e0f72-1a87-46ca-9aef-2c5a31b95201 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:12.889300 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a8e0f72-1a87-46ca-9aef-2c5a31b95201 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:12.889749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a8e0f72-1a87-46ca-9aef-2c5a31b95201 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:12.890556 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a8e0f72-1a87-46ca-9aef-2c5a31b95201 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:12.890993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a8e0f72-1a87-46ca-9aef-2c5a31b95201 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:12.920025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5a8e0f72-1a87-46ca-9aef-2c5a31b95201 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Nov 08 17:46:12.920603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 671/1366] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:13.035620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-320d86a4-66c4-4d32-9c44-0bc0d50b498a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:13.036524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-320d86a4-66c4-4d32-9c44-0bc0d50b498a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:13.043801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-320d86a4-66c4-4d32-9c44-0bc0d50b498a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:13.044245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-320d86a4-66c4-4d32-9c44-0bc0d50b498a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:13.045011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-320d86a4-66c4-4d32-9c44-0bc0d50b498a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:13.045438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-320d86a4-66c4-4d32-9c44-0bc0d50b498a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:13.073143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-320d86a4-66c4-4d32-9c44-0bc0d50b498a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041308 Nov 08 17:46:13.073682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 696/1367] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:13.529444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fbe81cd7-dd26-45f4-b4ec-d1fc045db089 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec263d30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:13.576209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fbe81cd7-dd26-45f4-b4ec-d1fc045db089 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050287 Nov 08 17:46:13.576787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 672/1368] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:13 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:13.931742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1d1d086d-4777-4daa-9729-4a1f7e24f17d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:13.932675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1d1d086d-4777-4daa-9729-4a1f7e24f17d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:13.938965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d1d086d-4777-4daa-9729-4a1f7e24f17d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:13.939411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d1d086d-4777-4daa-9729-4a1f7e24f17d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:13.940183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d1d086d-4777-4daa-9729-4a1f7e24f17d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:13.940618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1d1d086d-4777-4daa-9729-4a1f7e24f17d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:13.970289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1d1d086d-4777-4daa-9729-4a1f7e24f17d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042754 Nov 08 17:46:13.970870 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 697/1369] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:14.084951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-157b52a5-971a-4a2f-9c36-14a636c0d200 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:14.085851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-157b52a5-971a-4a2f-9c36-14a636c0d200 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:14.093415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-157b52a5-971a-4a2f-9c36-14a636c0d200 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:14.093864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-157b52a5-971a-4a2f-9c36-14a636c0d200 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:14.094668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-157b52a5-971a-4a2f-9c36-14a636c0d200 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:14.095108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-157b52a5-971a-4a2f-9c36-14a636c0d200 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:14.123833 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-157b52a5-971a-4a2f-9c36-14a636c0d200 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043119 Nov 08 17:46:14.124373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 673/1370] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:14.588316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3dd589e3-a842-4459-abb8-02f22e4c0986 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2d2af0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:14.632233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3dd589e3-a842-4459-abb8-02f22e4c0986 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048146 Nov 08 17:46:14.632807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 698/1371] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:14 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:14.981651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-09c6add4-f35f-4150-9df0-c632fd77ced8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:14.982595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-09c6add4-f35f-4150-9df0-c632fd77ced8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:14.988521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09c6add4-f35f-4150-9df0-c632fd77ced8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:14.989218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09c6add4-f35f-4150-9df0-c632fd77ced8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:14.989985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09c6add4-f35f-4150-9df0-c632fd77ced8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:14.990409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09c6add4-f35f-4150-9df0-c632fd77ced8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:15.020002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-09c6add4-f35f-4150-9df0-c632fd77ced8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042735 Nov 08 17:46:15.020567 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 674/1372] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:15.136063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-849eb16d-8826-4085-8766-bd15cc90cdee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:15.136949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-849eb16d-8826-4085-8766-bd15cc90cdee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:15.143397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-849eb16d-8826-4085-8766-bd15cc90cdee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:15.143847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-849eb16d-8826-4085-8766-bd15cc90cdee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:15.144628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-849eb16d-8826-4085-8766-bd15cc90cdee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:15.145057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-849eb16d-8826-4085-8766-bd15cc90cdee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:15.173900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-849eb16d-8826-4085-8766-bd15cc90cdee tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042557 Nov 08 17:46:15.174513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 699/1373] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:15.644885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6edfb6ee-2785-4b3b-8df4-3d42fe20a4fb tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2400d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:15.691046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6edfb6ee-2785-4b3b-8df4-3d42fe20a4fb tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049680 Nov 08 17:46:15.691635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 675/1374] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:15 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:16.032004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-43077a5c-11b3-418e-9cf6-341af753ebb7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:16.032925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-43077a5c-11b3-418e-9cf6-341af753ebb7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:16.038921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43077a5c-11b3-418e-9cf6-341af753ebb7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:16.039360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43077a5c-11b3-418e-9cf6-341af753ebb7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:16.040121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43077a5c-11b3-418e-9cf6-341af753ebb7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:16.040602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43077a5c-11b3-418e-9cf6-341af753ebb7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:16.067951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-43077a5c-11b3-418e-9cf6-341af753ebb7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039836 Nov 08 17:46:16.068490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 700/1375] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:16.184996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-55a60e8a-bcb0-4367-9742-f1dad4f3978b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:16.185910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-55a60e8a-bcb0-4367-9742-f1dad4f3978b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:16.191712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-55a60e8a-bcb0-4367-9742-f1dad4f3978b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:16.192154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-55a60e8a-bcb0-4367-9742-f1dad4f3978b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:16.192904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-55a60e8a-bcb0-4367-9742-f1dad4f3978b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:16.193328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-55a60e8a-bcb0-4367-9742-f1dad4f3978b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:16.223190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-55a60e8a-bcb0-4367-9742-f1dad4f3978b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042004 Nov 08 17:46:16.223736 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 676/1376] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:16.703427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-89ea5863-617f-40f4-8fec-afbfd6656324 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec209550>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:16.749185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-89ea5863-617f-40f4-8fec-afbfd6656324 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049363 Nov 08 17:46:16.749772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 701/1377] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:16 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:17.079888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7b55a117-fdc4-4123-84a0-4335a04952a6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:17.080708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7b55a117-fdc4-4123-84a0-4335a04952a6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:17.087900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b55a117-fdc4-4123-84a0-4335a04952a6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:17.088555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b55a117-fdc4-4123-84a0-4335a04952a6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:17.089335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b55a117-fdc4-4123-84a0-4335a04952a6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:17.089769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b55a117-fdc4-4123-84a0-4335a04952a6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:17.118552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7b55a117-fdc4-4123-84a0-4335a04952a6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042480 Nov 08 17:46:17.119109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 677/1378] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:17.234920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6c67e331-24f6-41e4-9d84-9acb4bbb4f07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:17.235834 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6c67e331-24f6-41e4-9d84-9acb4bbb4f07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:17.242630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6c67e331-24f6-41e4-9d84-9acb4bbb4f07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:17.243072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6c67e331-24f6-41e4-9d84-9acb4bbb4f07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:17.244078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6c67e331-24f6-41e4-9d84-9acb4bbb4f07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:17.244512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6c67e331-24f6-41e4-9d84-9acb4bbb4f07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:17.271537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6c67e331-24f6-41e4-9d84-9acb4bbb4f07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040339 Nov 08 17:46:17.272074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 702/1379] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:17.761562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-84f22b6d-7c12-4a9e-8eb4-81932b1b5b18 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2519d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:17.806877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-84f22b6d-7c12-4a9e-8eb4-81932b1b5b18 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048868 Nov 08 17:46:17.807488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 678/1380] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:17 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:18.129849 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-850f3958-72ce-4c46-b02f-13a37979771a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:18.130777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-850f3958-72ce-4c46-b02f-13a37979771a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:18.137663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-850f3958-72ce-4c46-b02f-13a37979771a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:18.138103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-850f3958-72ce-4c46-b02f-13a37979771a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:18.138895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-850f3958-72ce-4c46-b02f-13a37979771a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:18.139321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-850f3958-72ce-4c46-b02f-13a37979771a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:18.170284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-850f3958-72ce-4c46-b02f-13a37979771a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Nov 08 17:46:18.170863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 703/1381] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:18.284144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d1841af1-f34b-49ba-a6ba-2d8f7355749c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:18.285041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d1841af1-f34b-49ba-a6ba-2d8f7355749c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:18.292061 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1841af1-f34b-49ba-a6ba-2d8f7355749c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:18.292524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1841af1-f34b-49ba-a6ba-2d8f7355749c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:18.293282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1841af1-f34b-49ba-a6ba-2d8f7355749c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:18.293708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1841af1-f34b-49ba-a6ba-2d8f7355749c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:18.321366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d1841af1-f34b-49ba-a6ba-2d8f7355749c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041483 Nov 08 17:46:18.321978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 679/1382] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:18.819033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ee8dd58a-20ff-49c2-bbbc-51e4c7af2786 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec240700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:18.863977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ee8dd58a-20ff-49c2-bbbc-51e4c7af2786 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048315 Nov 08 17:46:18.864578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 704/1383] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:18 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:19.181069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-401d1a90-03db-4fbb-b7f2-734c3650e09b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:19.181982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-401d1a90-03db-4fbb-b7f2-734c3650e09b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:19.187760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-401d1a90-03db-4fbb-b7f2-734c3650e09b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:19.188201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-401d1a90-03db-4fbb-b7f2-734c3650e09b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:19.188954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-401d1a90-03db-4fbb-b7f2-734c3650e09b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:19.189380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-401d1a90-03db-4fbb-b7f2-734c3650e09b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:19.218906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-401d1a90-03db-4fbb-b7f2-734c3650e09b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041574 Nov 08 17:46:19.219455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 680/1384] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:46:19.332630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fe789ffd-db2f-4bf9-a6ad-1502defa8792 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:19.333526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fe789ffd-db2f-4bf9-a6ad-1502defa8792 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:19.339756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fe789ffd-db2f-4bf9-a6ad-1502defa8792 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:19.340206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fe789ffd-db2f-4bf9-a6ad-1502defa8792 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:19.340974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fe789ffd-db2f-4bf9-a6ad-1502defa8792 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:19.341410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fe789ffd-db2f-4bf9-a6ad-1502defa8792 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:19.370695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fe789ffd-db2f-4bf9-a6ad-1502defa8792 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042194 Nov 08 17:46:19.371245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 705/1385] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:19.876670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2c67c741-37ba-4281-810a-588c26cbc636 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2dd9d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:19.922351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2c67c741-37ba-4281-810a-588c26cbc636 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049455 Nov 08 17:46:19.922972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 681/1386] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:19 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:20.231413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e0e0f35c-7447-4e44-9661-d43113904fac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:20.232236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e0e0f35c-7447-4e44-9661-d43113904fac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:20.237954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e0e0f35c-7447-4e44-9661-d43113904fac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:20.238422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e0e0f35c-7447-4e44-9661-d43113904fac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:20.239457 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e0e0f35c-7447-4e44-9661-d43113904fac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:20.239884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e0e0f35c-7447-4e44-9661-d43113904fac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:20.268570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e0e0f35c-7447-4e44-9661-d43113904fac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041736 Nov 08 17:46:20.269112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 706/1387] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:20.382094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ec7a2fb3-442e-4040-b4ed-910c180125f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:20.383023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ec7a2fb3-442e-4040-b4ed-910c180125f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:20.389523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec7a2fb3-442e-4040-b4ed-910c180125f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:20.389947 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec7a2fb3-442e-4040-b4ed-910c180125f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:20.390733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec7a2fb3-442e-4040-b4ed-910c180125f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:20.391162 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec7a2fb3-442e-4040-b4ed-910c180125f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:20.419356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ec7a2fb3-442e-4040-b4ed-910c180125f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041016 Nov 08 17:46:20.419895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 682/1388] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:20.935083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3be51215-0ee8-4bc9-9f1a-175aad5551ca tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c10d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:20.979871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3be51215-0ee8-4bc9-9f1a-175aad5551ca tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048833 Nov 08 17:46:20.980639 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 707/1389] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:20 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:21.280547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3b5a9095-9cbe-409d-9c1b-50d67919070a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:21.281377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3b5a9095-9cbe-409d-9c1b-50d67919070a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:21.287578 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b5a9095-9cbe-409d-9c1b-50d67919070a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:21.288022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b5a9095-9cbe-409d-9c1b-50d67919070a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:21.288813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b5a9095-9cbe-409d-9c1b-50d67919070a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:21.289243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b5a9095-9cbe-409d-9c1b-50d67919070a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:21.317583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3b5a9095-9cbe-409d-9c1b-50d67919070a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Nov 08 17:46:21.318141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 683/1390] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:21.430743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-024edfc4-d8d0-4439-b41f-ce769785150a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:21.431646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-024edfc4-d8d0-4439-b41f-ce769785150a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:21.438358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-024edfc4-d8d0-4439-b41f-ce769785150a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:21.438831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-024edfc4-d8d0-4439-b41f-ce769785150a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:21.439600 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-024edfc4-d8d0-4439-b41f-ce769785150a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:21.440030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-024edfc4-d8d0-4439-b41f-ce769785150a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:21.468515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-024edfc4-d8d0-4439-b41f-ce769785150a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041582 Nov 08 17:46:21.469060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 708/1391] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:21.992610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3c7fead4-21fb-43c3-bfc2-9d88f4588172 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:22.038398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3c7fead4-21fb-43c3-bfc2-9d88f4588172 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049624 Nov 08 17:46:22.039102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 684/1392] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:21 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:22.329075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cd170f26-0c56-4b93-92cb-a62d38f3a978 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:22.329903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cd170f26-0c56-4b93-92cb-a62d38f3a978 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:22.336183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd170f26-0c56-4b93-92cb-a62d38f3a978 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:22.336631 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd170f26-0c56-4b93-92cb-a62d38f3a978 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:22.337402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd170f26-0c56-4b93-92cb-a62d38f3a978 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:22.337834 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd170f26-0c56-4b93-92cb-a62d38f3a978 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:22.366840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cd170f26-0c56-4b93-92cb-a62d38f3a978 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Nov 08 17:46:22.367388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 709/1393] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:22.481236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a2bd93fe-7abc-4b87-8610-6c76ed723a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:22.482115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a2bd93fe-7abc-4b87-8610-6c76ed723a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:22.488951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a2bd93fe-7abc-4b87-8610-6c76ed723a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:22.489385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a2bd93fe-7abc-4b87-8610-6c76ed723a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:22.490145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a2bd93fe-7abc-4b87-8610-6c76ed723a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:22.490598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a2bd93fe-7abc-4b87-8610-6c76ed723a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:22.517750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a2bd93fe-7abc-4b87-8610-6c76ed723a74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041306 Nov 08 17:46:22.518290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 685/1394] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:23.051332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-af923e77-d709-48b3-98d5-6b2c84e5240c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec23b4c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:23.096989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-af923e77-d709-48b3-98d5-6b2c84e5240c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049187 Nov 08 17:46:23.097677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 710/1395] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:23 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:23.378177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-04b40cad-317e-4c1c-a0bd-b91dd98e9146 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:23.379106 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-04b40cad-317e-4c1c-a0bd-b91dd98e9146 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:23.384889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04b40cad-317e-4c1c-a0bd-b91dd98e9146 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:23.385986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04b40cad-317e-4c1c-a0bd-b91dd98e9146 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:23.386780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04b40cad-317e-4c1c-a0bd-b91dd98e9146 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:23.387212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04b40cad-317e-4c1c-a0bd-b91dd98e9146 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:23.416046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-04b40cad-317e-4c1c-a0bd-b91dd98e9146 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Nov 08 17:46:23.417364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 686/1396] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:23.529360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a7afbbac-472c-49de-8881-2c83e24ac665 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:23.530763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a7afbbac-472c-49de-8881-2c83e24ac665 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:23.536736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a7afbbac-472c-49de-8881-2c83e24ac665 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:23.537178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a7afbbac-472c-49de-8881-2c83e24ac665 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:23.537939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a7afbbac-472c-49de-8881-2c83e24ac665 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:23.538368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a7afbbac-472c-49de-8881-2c83e24ac665 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:23.567336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a7afbbac-472c-49de-8881-2c83e24ac665 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042105 Nov 08 17:46:23.567904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 711/1397] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:24.109370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-442f425c-dc39-4391-8a9e-f7d51d5a84e4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec390430>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:24.154667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-442f425c-dc39-4391-8a9e-f7d51d5a84e4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048785 Nov 08 17:46:24.155267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 687/1398] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:24 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:24.428163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-908caa8d-c05b-4af6-8aac-153a604a3843 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:24.429071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-908caa8d-c05b-4af6-8aac-153a604a3843 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:24.434922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908caa8d-c05b-4af6-8aac-153a604a3843 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:24.435395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908caa8d-c05b-4af6-8aac-153a604a3843 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:24.436163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908caa8d-c05b-4af6-8aac-153a604a3843 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:24.436596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908caa8d-c05b-4af6-8aac-153a604a3843 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:24.465047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-908caa8d-c05b-4af6-8aac-153a604a3843 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040614 Nov 08 17:46:24.465585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 712/1399] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:24.579414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d394b15e-ed62-48e8-912d-56797c848593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:24.580302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d394b15e-ed62-48e8-912d-56797c848593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:24.586079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d394b15e-ed62-48e8-912d-56797c848593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:24.586554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d394b15e-ed62-48e8-912d-56797c848593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:24.587310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d394b15e-ed62-48e8-912d-56797c848593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:24.587754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d394b15e-ed62-48e8-912d-56797c848593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:24.615624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d394b15e-ed62-48e8-912d-56797c848593 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039905 Nov 08 17:46:24.616166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 688/1400] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:25.166831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-efcaa82b-b87f-4368-9983-6a5c1de15a48 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec21fee0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:25.212122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-efcaa82b-b87f-4368-9983-6a5c1de15a48 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048928 Nov 08 17:46:25.212683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 713/1401] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:25 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:25.475677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3afcd7ca-bda5-44f6-865c-36ffe77398a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:25.476610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3afcd7ca-bda5-44f6-865c-36ffe77398a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:25.483395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3afcd7ca-bda5-44f6-865c-36ffe77398a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:25.483857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3afcd7ca-bda5-44f6-865c-36ffe77398a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:25.484614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3afcd7ca-bda5-44f6-865c-36ffe77398a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:25.485040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3afcd7ca-bda5-44f6-865c-36ffe77398a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:25.512623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3afcd7ca-bda5-44f6-865c-36ffe77398a3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040621 Nov 08 17:46:25.513112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 689/1402] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:25.628663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e393eeef-74b7-4346-80c5-87d4538268d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:25.629930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e393eeef-74b7-4346-80c5-87d4538268d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:25.636747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e393eeef-74b7-4346-80c5-87d4538268d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:25.637201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e393eeef-74b7-4346-80c5-87d4538268d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:25.645272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e393eeef-74b7-4346-80c5-87d4538268d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:25.645272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e393eeef-74b7-4346-80c5-87d4538268d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:25.667028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e393eeef-74b7-4346-80c5-87d4538268d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042494 Nov 08 17:46:25.667641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 714/1403] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:46:26.224821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-48ad6a83-c0de-4f00-8ab4-06b1057a3abc tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec240430>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:26.270645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-48ad6a83-c0de-4f00-8ab4-06b1057a3abc tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049317 Nov 08 17:46:26.271224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 690/1404] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:26 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:26.523341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d7497ef9-d4d5-4983-b0df-65cf72d02b47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:26.524163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d7497ef9-d4d5-4983-b0df-65cf72d02b47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:26.530350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7497ef9-d4d5-4983-b0df-65cf72d02b47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:26.530821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7497ef9-d4d5-4983-b0df-65cf72d02b47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:26.531582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7497ef9-d4d5-4983-b0df-65cf72d02b47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:26.532015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d7497ef9-d4d5-4983-b0df-65cf72d02b47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:26.562054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d7497ef9-d4d5-4983-b0df-65cf72d02b47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 Nov 08 17:46:26.562633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 715/1405] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:26.678979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c6f8ffba-1f03-4950-80fb-46773dd91e67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:26.679870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c6f8ffba-1f03-4950-80fb-46773dd91e67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:26.687019 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c6f8ffba-1f03-4950-80fb-46773dd91e67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:26.687459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c6f8ffba-1f03-4950-80fb-46773dd91e67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:26.688222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c6f8ffba-1f03-4950-80fb-46773dd91e67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:26.688648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c6f8ffba-1f03-4950-80fb-46773dd91e67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:26.715864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c6f8ffba-1f03-4950-80fb-46773dd91e67 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041130 Nov 08 17:46:26.716404 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 691/1406] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:27.282947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-12bacab1-8618-4376-9639-9a47202a09bf tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec6f4ee0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:27.327575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-12bacab1-8618-4376-9639-9a47202a09bf tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048278 Nov 08 17:46:27.328146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 716/1407] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:27 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:27.573516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f6006ab-ef29-466a-9ca5-1c9ff41605e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:27.574355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5f6006ab-ef29-466a-9ca5-1c9ff41605e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:27.580197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f6006ab-ef29-466a-9ca5-1c9ff41605e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:27.580635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f6006ab-ef29-466a-9ca5-1c9ff41605e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:27.581396 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f6006ab-ef29-466a-9ca5-1c9ff41605e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:27.581850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f6006ab-ef29-466a-9ca5-1c9ff41605e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:27.609445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5f6006ab-ef29-466a-9ca5-1c9ff41605e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040284 Nov 08 17:46:27.609991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 692/1408] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:27.727507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9d29edce-0a9e-41c1-909f-8da577aee586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:27.728387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9d29edce-0a9e-41c1-909f-8da577aee586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:27.734287 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9d29edce-0a9e-41c1-909f-8da577aee586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:27.734823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9d29edce-0a9e-41c1-909f-8da577aee586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:27.735605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9d29edce-0a9e-41c1-909f-8da577aee586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:27.736030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9d29edce-0a9e-41c1-909f-8da577aee586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:27.915795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9d29edce-0a9e-41c1-909f-8da577aee586 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.192361 Nov 08 17:46:27.916923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 717/1409] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:28.339832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2041f63a-283f-4643-bef0-3664fcc5027e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec263d30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:28.384522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2041f63a-283f-4643-bef0-3664fcc5027e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048353 Nov 08 17:46:28.386451 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 693/1410] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:28 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:28.621240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b4024df4-dfc8-4a7c-9e02-9324c38e9dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:28.622151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b4024df4-dfc8-4a7c-9e02-9324c38e9dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:28.628013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4024df4-dfc8-4a7c-9e02-9324c38e9dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:28.628459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4024df4-dfc8-4a7c-9e02-9324c38e9dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:28.629268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4024df4-dfc8-4a7c-9e02-9324c38e9dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:28.629699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4024df4-dfc8-4a7c-9e02-9324c38e9dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:28.658135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b4024df4-dfc8-4a7c-9e02-9324c38e9dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041270 Nov 08 17:46:28.658693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 718/1411] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:28.927155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f12243ae-ace0-4cf4-8eec-a8ed8dce73ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:28.927978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f12243ae-ace0-4cf4-8eec-a8ed8dce73ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:28.935304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f12243ae-ace0-4cf4-8eec-a8ed8dce73ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:28.935742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f12243ae-ace0-4cf4-8eec-a8ed8dce73ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:28.936501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f12243ae-ace0-4cf4-8eec-a8ed8dce73ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:28.936926 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f12243ae-ace0-4cf4-8eec-a8ed8dce73ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:28.964205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f12243ae-ace0-4cf4-8eec-a8ed8dce73ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040857 Nov 08 17:46:28.964741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 694/1412] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:29.397878 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f78fcc36-4acb-4d5d-b6a2-acb691142981 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2138b0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:29.443277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f78fcc36-4acb-4d5d-b6a2-acb691142981 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048970 Nov 08 17:46:29.443833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 719/1413] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:29 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:29.669072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3d685af5-db06-4c93-8c02-51253bacffb8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:29.670001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3d685af5-db06-4c93-8c02-51253bacffb8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:29.676224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d685af5-db06-4c93-8c02-51253bacffb8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:29.676665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d685af5-db06-4c93-8c02-51253bacffb8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:29.677421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d685af5-db06-4c93-8c02-51253bacffb8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:29.677852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d685af5-db06-4c93-8c02-51253bacffb8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:29.706411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3d685af5-db06-4c93-8c02-51253bacffb8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041165 Nov 08 17:46:29.706991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 695/1414] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:29.974825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0e9ea956-6e9e-4f6d-9c64-1cc86a031aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:29.975660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0e9ea956-6e9e-4f6d-9c64-1cc86a031aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:29.982181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e9ea956-6e9e-4f6d-9c64-1cc86a031aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:29.982659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e9ea956-6e9e-4f6d-9c64-1cc86a031aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:29.983439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e9ea956-6e9e-4f6d-9c64-1cc86a031aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:29.983874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e9ea956-6e9e-4f6d-9c64-1cc86a031aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:30.013182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0e9ea956-6e9e-4f6d-9c64-1cc86a031aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042204 Nov 08 17:46:30.013722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 720/1415] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:30.455105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2f3c716b-d308-4768-b65c-65c31ad5ded3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c1f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:30.502100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2f3c716b-d308-4768-b65c-65c31ad5ded3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050504 Nov 08 17:46:30.502699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 696/1416] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:30 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:30.717395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-76da3f4f-ba29-4792-9b91-5159dbbbbd7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:30.718331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-76da3f4f-ba29-4792-9b91-5159dbbbbd7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:30.724595 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76da3f4f-ba29-4792-9b91-5159dbbbbd7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:30.725046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76da3f4f-ba29-4792-9b91-5159dbbbbd7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:30.725820 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76da3f4f-ba29-4792-9b91-5159dbbbbd7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:30.726251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76da3f4f-ba29-4792-9b91-5159dbbbbd7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:30.756268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-76da3f4f-ba29-4792-9b91-5159dbbbbd7f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 Nov 08 17:46:30.756829 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 721/1417] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:31.024601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-44378eca-2027-4816-b629-a807042ab2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:31.026130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-44378eca-2027-4816-b629-a807042ab2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:31.032737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44378eca-2027-4816-b629-a807042ab2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:31.033184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44378eca-2027-4816-b629-a807042ab2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:31.033949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44378eca-2027-4816-b629-a807042ab2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:31.034395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44378eca-2027-4816-b629-a807042ab2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:31.062040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-44378eca-2027-4816-b629-a807042ab2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041637 Nov 08 17:46:31.062608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 697/1418] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:31.513383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dc14a03a-7027-4561-9a1e-eddcdba441e4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c54c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:31.558055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dc14a03a-7027-4561-9a1e-eddcdba441e4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048294 Nov 08 17:46:31.559814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 722/1419] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:31 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:31.767072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-179fd4f7-957f-4850-8fd0-160bfb8b2bb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:31.767969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-179fd4f7-957f-4850-8fd0-160bfb8b2bb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:31.773690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-179fd4f7-957f-4850-8fd0-160bfb8b2bb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:31.774128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-179fd4f7-957f-4850-8fd0-160bfb8b2bb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:31.774920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-179fd4f7-957f-4850-8fd0-160bfb8b2bb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:31.775940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-179fd4f7-957f-4850-8fd0-160bfb8b2bb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:31.804591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-179fd4f7-957f-4850-8fd0-160bfb8b2bb3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Nov 08 17:46:31.805129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 698/1420] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:32.074791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e72fe76f-710b-4d77-8d9e-6ccdc21c9e44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:32.075691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e72fe76f-710b-4d77-8d9e-6ccdc21c9e44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:32.082026 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e72fe76f-710b-4d77-8d9e-6ccdc21c9e44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:32.082494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e72fe76f-710b-4d77-8d9e-6ccdc21c9e44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:32.083292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e72fe76f-710b-4d77-8d9e-6ccdc21c9e44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:32.083776 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e72fe76f-710b-4d77-8d9e-6ccdc21c9e44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:32.112021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e72fe76f-710b-4d77-8d9e-6ccdc21c9e44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042743 Nov 08 17:46:32.112557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 723/1421] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:32.240018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:46:32.240524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:46:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:46:32.570142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-70738c20-dd9e-4135-b48f-0e856bcfbad1 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2298b0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:32.615127 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-70738c20-dd9e-4135-b48f-0e856bcfbad1 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048599 Nov 08 17:46:32.615687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 699/1422] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:32 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:32.816157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-98cd1e0d-32d9-45b6-870d-7efbf2bb8184 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:32.816991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-98cd1e0d-32d9-45b6-870d-7efbf2bb8184 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:32.823357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-98cd1e0d-32d9-45b6-870d-7efbf2bb8184 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:32.823805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-98cd1e0d-32d9-45b6-870d-7efbf2bb8184 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:32.824581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-98cd1e0d-32d9-45b6-870d-7efbf2bb8184 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:32.825011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-98cd1e0d-32d9-45b6-870d-7efbf2bb8184 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:32.852684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-98cd1e0d-32d9-45b6-870d-7efbf2bb8184 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040335 Nov 08 17:46:32.853226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 724/1423] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:33.124615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2560e9ad-8cb7-4b04-acaf-ad55270b0223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:33.125510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2560e9ad-8cb7-4b04-acaf-ad55270b0223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:33.132117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2560e9ad-8cb7-4b04-acaf-ad55270b0223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:33.132554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2560e9ad-8cb7-4b04-acaf-ad55270b0223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:33.133314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2560e9ad-8cb7-4b04-acaf-ad55270b0223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:33.133745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2560e9ad-8cb7-4b04-acaf-ad55270b0223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:33.167095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2560e9ad-8cb7-4b04-acaf-ad55270b0223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046216 Nov 08 17:46:33.167663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 700/1424] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:46:33.626836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dd7acbba-d835-42e2-9629-e58f4f36d55d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec213f70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:33.671967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dd7acbba-d835-42e2-9629-e58f4f36d55d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048617 Nov 08 17:46:33.672524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 725/1425] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:33 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:33.862900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-57ac0a9c-d195-4be8-98dc-a01c76650127 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:33.864048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-57ac0a9c-d195-4be8-98dc-a01c76650127 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:33.870364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-57ac0a9c-d195-4be8-98dc-a01c76650127 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:33.870838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-57ac0a9c-d195-4be8-98dc-a01c76650127 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:33.871763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-57ac0a9c-d195-4be8-98dc-a01c76650127 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:33.872185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-57ac0a9c-d195-4be8-98dc-a01c76650127 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:33.900167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-57ac0a9c-d195-4be8-98dc-a01c76650127 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040884 Nov 08 17:46:33.901314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 701/1426] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:34.178718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-149a2e51-d336-4c50-a9d6-19b2515b5d0c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:34.179553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-149a2e51-d336-4c50-a9d6-19b2515b5d0c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:34.186431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-149a2e51-d336-4c50-a9d6-19b2515b5d0c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:34.192312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-149a2e51-d336-4c50-a9d6-19b2515b5d0c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:34.192312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-149a2e51-d336-4c50-a9d6-19b2515b5d0c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:34.192312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-149a2e51-d336-4c50-a9d6-19b2515b5d0c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:34.217918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-149a2e51-d336-4c50-a9d6-19b2515b5d0c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043107 Nov 08 17:46:34.218482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 726/1427] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:34.684472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-34500081-723c-4970-b506-11c3bbfb3899 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1d7ca0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:34.729966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-34500081-723c-4970-b506-11c3bbfb3899 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049642 Nov 08 17:46:34.730548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 702/1428] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:34 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:34.912033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-82dac17e-0f58-4636-b6a2-676962ab15f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:34.912929 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-82dac17e-0f58-4636-b6a2-676962ab15f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:34.919970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-82dac17e-0f58-4636-b6a2-676962ab15f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:34.920409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-82dac17e-0f58-4636-b6a2-676962ab15f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:34.921162 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-82dac17e-0f58-4636-b6a2-676962ab15f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:34.921591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-82dac17e-0f58-4636-b6a2-676962ab15f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:34.949838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-82dac17e-0f58-4636-b6a2-676962ab15f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041550 Nov 08 17:46:34.950358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 727/1429] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:35.230271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f31ab0f9-2084-49df-b49c-f406bdce7043 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:35.231222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f31ab0f9-2084-49df-b49c-f406bdce7043 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:35.237753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f31ab0f9-2084-49df-b49c-f406bdce7043 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:35.238185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f31ab0f9-2084-49df-b49c-f406bdce7043 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:35.239229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f31ab0f9-2084-49df-b49c-f406bdce7043 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:35.239656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f31ab0f9-2084-49df-b49c-f406bdce7043 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:35.266495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f31ab0f9-2084-49df-b49c-f406bdce7043 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041142 Nov 08 17:46:35.267029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 703/1430] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:46:35.742373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e9d9ed53-1ac1-477b-90ad-15acedca6833 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24a160>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:35.793619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e9d9ed53-1ac1-477b-90ad-15acedca6833 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050308 Nov 08 17:46:35.793619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 728/1431] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:35 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:35.961025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-754175b3-4e7b-4981-8bba-0fec5c161841 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:35.961918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-754175b3-4e7b-4981-8bba-0fec5c161841 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:35.967756 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754175b3-4e7b-4981-8bba-0fec5c161841 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:35.968192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754175b3-4e7b-4981-8bba-0fec5c161841 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:35.968944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754175b3-4e7b-4981-8bba-0fec5c161841 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:35.969370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754175b3-4e7b-4981-8bba-0fec5c161841 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:35.997997 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-754175b3-4e7b-4981-8bba-0fec5c161841 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040688 Nov 08 17:46:35.998506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 704/1432] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:36.277994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-36f84571-9a4c-4314-9117-d4f1f0bfc4a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:36.278882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-36f84571-9a4c-4314-9117-d4f1f0bfc4a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:36.285828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36f84571-9a4c-4314-9117-d4f1f0bfc4a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:36.286284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36f84571-9a4c-4314-9117-d4f1f0bfc4a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:36.287112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36f84571-9a4c-4314-9117-d4f1f0bfc4a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:36.287542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36f84571-9a4c-4314-9117-d4f1f0bfc4a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:36.316358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-36f84571-9a4c-4314-9117-d4f1f0bfc4a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042182 Nov 08 17:46:36.316888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 729/1433] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:36.800798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a07a13db-41f3-48f2-8e96-daa335892365 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2515e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:36.845447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a07a13db-41f3-48f2-8e96-daa335892365 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048116 Nov 08 17:46:36.846019 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 705/1434] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:36 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:37.009115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-95245624-a5ef-41db-94b6-0c7a634abf6f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:37.010580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-95245624-a5ef-41db-94b6-0c7a634abf6f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:37.016397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95245624-a5ef-41db-94b6-0c7a634abf6f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:37.016837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95245624-a5ef-41db-94b6-0c7a634abf6f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:37.017602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95245624-a5ef-41db-94b6-0c7a634abf6f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:37.018031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95245624-a5ef-41db-94b6-0c7a634abf6f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:37.046683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-95245624-a5ef-41db-94b6-0c7a634abf6f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041172 Nov 08 17:46:37.057192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 730/1435] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:37.328958 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7a14e4ff-4008-4bb1-bf49-8e388ba8caef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:37.329888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7a14e4ff-4008-4bb1-bf49-8e388ba8caef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:37.336429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a14e4ff-4008-4bb1-bf49-8e388ba8caef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:37.336873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a14e4ff-4008-4bb1-bf49-8e388ba8caef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:37.337681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a14e4ff-4008-4bb1-bf49-8e388ba8caef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:37.338350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a14e4ff-4008-4bb1-bf49-8e388ba8caef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:37.366006 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7a14e4ff-4008-4bb1-bf49-8e388ba8caef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040976 Nov 08 17:46:37.366585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 706/1436] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:37.856784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-af4054fc-e237-4417-9009-89989e962e3c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24a550>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:37.902998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-af4054fc-e237-4417-9009-89989e962e3c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049700 Nov 08 17:46:37.903561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 731/1437] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:37 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:38.066309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-492daf63-c826-42da-8496-88951ac97fd6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:38.067246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-492daf63-c826-42da-8496-88951ac97fd6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:38.073961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-492daf63-c826-42da-8496-88951ac97fd6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:38.074411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-492daf63-c826-42da-8496-88951ac97fd6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:38.075208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-492daf63-c826-42da-8496-88951ac97fd6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:38.075643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-492daf63-c826-42da-8496-88951ac97fd6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:38.103306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-492daf63-c826-42da-8496-88951ac97fd6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040754 Nov 08 17:46:38.103988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 707/1438] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:38.377254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d9b63ba7-fb6b-4bd4-b5c3-221ec36fd6fc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:38.378152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d9b63ba7-fb6b-4bd4-b5c3-221ec36fd6fc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:38.384740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d9b63ba7-fb6b-4bd4-b5c3-221ec36fd6fc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:38.385190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d9b63ba7-fb6b-4bd4-b5c3-221ec36fd6fc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:38.385990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d9b63ba7-fb6b-4bd4-b5c3-221ec36fd6fc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:38.386426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d9b63ba7-fb6b-4bd4-b5c3-221ec36fd6fc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:38.415235 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d9b63ba7-fb6b-4bd4-b5c3-221ec36fd6fc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041892 Nov 08 17:46:38.416403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 732/1439] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:46:38.914880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4373abb7-d7d7-40fc-a573-c6be396bf4d4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec279550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:38.960695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4373abb7-d7d7-40fc-a573-c6be396bf4d4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049322 Nov 08 17:46:38.961261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 708/1440] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:38 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:39.114752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5392833f-1c07-4af3-a874-4c8231a36f26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:39.115661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5392833f-1c07-4af3-a874-4c8231a36f26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:39.122578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5392833f-1c07-4af3-a874-4c8231a36f26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:39.123048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5392833f-1c07-4af3-a874-4c8231a36f26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:39.123817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5392833f-1c07-4af3-a874-4c8231a36f26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:39.124249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5392833f-1c07-4af3-a874-4c8231a36f26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:39.152800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5392833f-1c07-4af3-a874-4c8231a36f26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Nov 08 17:46:39.153339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 733/1441] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:39.427638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a8444db6-90c4-4e83-9b76-ebff50fc1d6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:39.428595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a8444db6-90c4-4e83-9b76-ebff50fc1d6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:39.436007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a8444db6-90c4-4e83-9b76-ebff50fc1d6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:39.436476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a8444db6-90c4-4e83-9b76-ebff50fc1d6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:39.437280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a8444db6-90c4-4e83-9b76-ebff50fc1d6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:39.437715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a8444db6-90c4-4e83-9b76-ebff50fc1d6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:39.465128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a8444db6-90c4-4e83-9b76-ebff50fc1d6c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041309 Nov 08 17:46:39.465677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 709/1442] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:46:39.972828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-01417681-6cb5-42f2-a2cd-88d8e90f87cb tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c5670>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:40.018245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-01417681-6cb5-42f2-a2cd-88d8e90f87cb tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049025 Nov 08 17:46:40.018835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 734/1443] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:39 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:40.163876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1ad10751-9f1f-465b-814c-9a483fcfb664 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:40.164818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1ad10751-9f1f-465b-814c-9a483fcfb664 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:40.171013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ad10751-9f1f-465b-814c-9a483fcfb664 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:40.171454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ad10751-9f1f-465b-814c-9a483fcfb664 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:40.172216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ad10751-9f1f-465b-814c-9a483fcfb664 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:40.172643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ad10751-9f1f-465b-814c-9a483fcfb664 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:40.202069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1ad10751-9f1f-465b-814c-9a483fcfb664 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041884 Nov 08 17:46:40.202645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 710/1444] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:40.476817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8f9c9afe-7288-4c2c-8316-376e0a3748a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:40.477710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8f9c9afe-7288-4c2c-8316-376e0a3748a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:40.484301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8f9c9afe-7288-4c2c-8316-376e0a3748a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:40.484742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8f9c9afe-7288-4c2c-8316-376e0a3748a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:40.485499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8f9c9afe-7288-4c2c-8316-376e0a3748a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:40.485950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8f9c9afe-7288-4c2c-8316-376e0a3748a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:40.514404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8f9c9afe-7288-4c2c-8316-376e0a3748a1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041503 Nov 08 17:46:40.514974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 735/1445] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:41.030813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-12224362-7307-4285-91b1-28350338d740 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2510d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:41.075155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-12224362-7307-4285-91b1-28350338d740 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048020 Nov 08 17:46:41.075721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 711/1446] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:41 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:41.213877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a312e663-f00f-455b-9285-30c3acd4bc97 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:41.214812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a312e663-f00f-455b-9285-30c3acd4bc97 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:41.221320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a312e663-f00f-455b-9285-30c3acd4bc97 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:41.221772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a312e663-f00f-455b-9285-30c3acd4bc97 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:41.222547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a312e663-f00f-455b-9285-30c3acd4bc97 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:41.222978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a312e663-f00f-455b-9285-30c3acd4bc97 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:41.252419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a312e663-f00f-455b-9285-30c3acd4bc97 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042888 Nov 08 17:46:41.252874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 736/1447] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:41.526649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b0b0ade1-2143-458f-9fca-ac9c62411f5a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:41.527455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b0b0ade1-2143-458f-9fca-ac9c62411f5a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:41.533255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b0b0ade1-2143-458f-9fca-ac9c62411f5a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:41.533693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b0b0ade1-2143-458f-9fca-ac9c62411f5a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:41.534446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b0b0ade1-2143-458f-9fca-ac9c62411f5a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:41.534915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b0b0ade1-2143-458f-9fca-ac9c62411f5a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:41.562445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b0b0ade1-2143-458f-9fca-ac9c62411f5a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040662 Nov 08 17:46:41.563004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 712/1448] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:42.087195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c24aad21-87f3-4f35-b750-56b87ece198c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec334ee0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:42.131825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c24aad21-87f3-4f35-b750-56b87ece198c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048160 Nov 08 17:46:42.132546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 737/1449] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:42 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:42.263681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3602402e-ae86-4f9d-9c62-4bf0de6ba726 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:42.264524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3602402e-ae86-4f9d-9c62-4bf0de6ba726 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:42.270269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3602402e-ae86-4f9d-9c62-4bf0de6ba726 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:42.270744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3602402e-ae86-4f9d-9c62-4bf0de6ba726 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:42.271553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3602402e-ae86-4f9d-9c62-4bf0de6ba726 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:42.271995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3602402e-ae86-4f9d-9c62-4bf0de6ba726 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:42.300388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3602402e-ae86-4f9d-9c62-4bf0de6ba726 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040634 Nov 08 17:46:42.300960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 713/1450] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:42.574330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1f330499-6553-43b9-a5ed-a504c3faf25f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:42.575261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1f330499-6553-43b9-a5ed-a504c3faf25f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:42.581752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f330499-6553-43b9-a5ed-a504c3faf25f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:42.582198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f330499-6553-43b9-a5ed-a504c3faf25f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:42.583080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f330499-6553-43b9-a5ed-a504c3faf25f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:42.583516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f330499-6553-43b9-a5ed-a504c3faf25f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:42.611712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1f330499-6553-43b9-a5ed-a504c3faf25f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042254 Nov 08 17:46:42.612246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 738/1451] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:43.145069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c012dde1-f85f-408d-bbe8-5e2dcdc5d685 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec279ca0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:43.189757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c012dde1-f85f-408d-bbe8-5e2dcdc5d685 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048188 Nov 08 17:46:43.190325 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 714/1452] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:43 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:43.312029 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ffb8f5e8-cc08-4c49-a60e-5039b254f7ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:43.313074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ffb8f5e8-cc08-4c49-a60e-5039b254f7ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:43.319440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ffb8f5e8-cc08-4c49-a60e-5039b254f7ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:43.319934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ffb8f5e8-cc08-4c49-a60e-5039b254f7ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:43.320748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ffb8f5e8-cc08-4c49-a60e-5039b254f7ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:43.321223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ffb8f5e8-cc08-4c49-a60e-5039b254f7ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:43.349491 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ffb8f5e8-cc08-4c49-a60e-5039b254f7ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041145 Nov 08 17:46:43.350032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 739/1453] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:43.623772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c4ecf806-3b19-4ddd-9b41-4ab431a0d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:43.624673 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c4ecf806-3b19-4ddd-9b41-4ab431a0d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:43.631186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4ecf806-3b19-4ddd-9b41-4ab431a0d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:43.631627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4ecf806-3b19-4ddd-9b41-4ab431a0d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:43.632394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4ecf806-3b19-4ddd-9b41-4ab431a0d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:43.632824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4ecf806-3b19-4ddd-9b41-4ab431a0d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:43.661170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c4ecf806-3b19-4ddd-9b41-4ab431a0d973 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041110 Nov 08 17:46:43.661720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 715/1454] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:44.200789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-840419ce-8bf0-4e84-b588-b95418b55a6f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2131f0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:44.247119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-840419ce-8bf0-4e84-b588-b95418b55a6f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049845 Nov 08 17:46:44.247688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 740/1455] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:44 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:44.360685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9bfa228e-80cc-4cb2-86e2-c7011c8ef438 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:44.361584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9bfa228e-80cc-4cb2-86e2-c7011c8ef438 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:44.368138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9bfa228e-80cc-4cb2-86e2-c7011c8ef438 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:44.368593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9bfa228e-80cc-4cb2-86e2-c7011c8ef438 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:44.369348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9bfa228e-80cc-4cb2-86e2-c7011c8ef438 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:44.369775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9bfa228e-80cc-4cb2-86e2-c7011c8ef438 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:44.397014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9bfa228e-80cc-4cb2-86e2-c7011c8ef438 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040018 Nov 08 17:46:44.397556 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 716/1456] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:44.672909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-89d8f8b0-046a-4b4b-9b8f-277ce43b2570 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:44.673830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-89d8f8b0-046a-4b4b-9b8f-277ce43b2570 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:44.680399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-89d8f8b0-046a-4b4b-9b8f-277ce43b2570 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:44.680843 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-89d8f8b0-046a-4b4b-9b8f-277ce43b2570 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:44.681831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-89d8f8b0-046a-4b4b-9b8f-277ce43b2570 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:44.682269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-89d8f8b0-046a-4b4b-9b8f-277ce43b2570 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:44.710556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-89d8f8b0-046a-4b4b-9b8f-277ce43b2570 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041368 Nov 08 17:46:44.711172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 741/1457] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:45.259504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-488b10f2-17ce-4318-844b-ddf018d004b7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec229310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:45.304030 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-488b10f2-17ce-4318-844b-ddf018d004b7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048212 Nov 08 17:46:45.304595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 717/1458] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:45 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:45.408828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fd335694-2f09-4be2-9326-33cfe8d2402b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:45.409765 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fd335694-2f09-4be2-9326-33cfe8d2402b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:45.416521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd335694-2f09-4be2-9326-33cfe8d2402b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:45.416966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd335694-2f09-4be2-9326-33cfe8d2402b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:45.417731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd335694-2f09-4be2-9326-33cfe8d2402b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:45.418167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd335694-2f09-4be2-9326-33cfe8d2402b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:45.446054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fd335694-2f09-4be2-9326-33cfe8d2402b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040954 Nov 08 17:46:45.446667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 742/1459] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:45.722427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cca505fa-5d71-45cc-bb91-5426b5f579ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:45.723363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cca505fa-5d71-45cc-bb91-5426b5f579ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:45.730482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cca505fa-5d71-45cc-bb91-5426b5f579ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:45.730950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cca505fa-5d71-45cc-bb91-5426b5f579ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:45.731707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cca505fa-5d71-45cc-bb91-5426b5f579ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:45.732136 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cca505fa-5d71-45cc-bb91-5426b5f579ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:45.759953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cca505fa-5d71-45cc-bb91-5426b5f579ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041591 Nov 08 17:46:45.760517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 718/1460] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:46.316938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d54fd933-1e39-4206-9212-559164db9a36 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec23b280>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:46.361376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d54fd933-1e39-4206-9212-559164db9a36 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048061 Nov 08 17:46:46.361929 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 743/1461] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:46 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:46.456845 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9b82cbe0-008c-45df-a91b-377fc5e75bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:46.457749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9b82cbe0-008c-45df-a91b-377fc5e75bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:46.464793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b82cbe0-008c-45df-a91b-377fc5e75bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:46.465234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b82cbe0-008c-45df-a91b-377fc5e75bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:46.466001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b82cbe0-008c-45df-a91b-377fc5e75bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:46.466431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b82cbe0-008c-45df-a91b-377fc5e75bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:46.494682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9b82cbe0-008c-45df-a91b-377fc5e75bfd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041457 Nov 08 17:46:46.495223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 719/1462] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:46.771773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3cc7b8d6-25c4-40b1-97da-a91b4cfaad3b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:46.772660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3cc7b8d6-25c4-40b1-97da-a91b4cfaad3b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:46.779192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3cc7b8d6-25c4-40b1-97da-a91b4cfaad3b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:46.779633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3cc7b8d6-25c4-40b1-97da-a91b4cfaad3b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:46.780397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3cc7b8d6-25c4-40b1-97da-a91b4cfaad3b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:46.780850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3cc7b8d6-25c4-40b1-97da-a91b4cfaad3b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:46.808955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3cc7b8d6-25c4-40b1-97da-a91b4cfaad3b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041381 Nov 08 17:46:46.809497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 744/1463] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:47.373741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-587434c9-bd85-485a-bf7d-1f15f295baab tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec229310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:47.418777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-587434c9-bd85-485a-bf7d-1f15f295baab tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048519 Nov 08 17:46:47.419349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 720/1464] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:47 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:47.504876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b43ea927-aa40-48b0-8ed0-eae837f1302e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:47.505775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b43ea927-aa40-48b0-8ed0-eae837f1302e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:47.512068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b43ea927-aa40-48b0-8ed0-eae837f1302e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:47.512511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b43ea927-aa40-48b0-8ed0-eae837f1302e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:47.513270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b43ea927-aa40-48b0-8ed0-eae837f1302e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:47.513698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b43ea927-aa40-48b0-8ed0-eae837f1302e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:47.541944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b43ea927-aa40-48b0-8ed0-eae837f1302e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Nov 08 17:46:47.542521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 745/1465] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:47.820423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-98858d91-505d-4d96-9fac-40d84eb63856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:47.821275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-98858d91-505d-4d96-9fac-40d84eb63856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:47.828502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98858d91-505d-4d96-9fac-40d84eb63856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:47.828946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98858d91-505d-4d96-9fac-40d84eb63856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:47.829710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98858d91-505d-4d96-9fac-40d84eb63856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:47.830137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98858d91-505d-4d96-9fac-40d84eb63856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:47.857541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-98858d91-505d-4d96-9fac-40d84eb63856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040964 Nov 08 17:46:47.858079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 721/1466] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:48.431522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b7a22f1f-1f03-4802-b43c-f6f81b304b05 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24ad30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:48.477527 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b7a22f1f-1f03-4802-b43c-f6f81b304b05 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050128 Nov 08 17:46:48.478828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 746/1467] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:48 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:48.553406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9e57b5b4-f3b1-4ebe-bc2a-c46ea516b9e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:48.554304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9e57b5b4-f3b1-4ebe-bc2a-c46ea516b9e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:48.561210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9e57b5b4-f3b1-4ebe-bc2a-c46ea516b9e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:48.561557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9e57b5b4-f3b1-4ebe-bc2a-c46ea516b9e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:48.562328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9e57b5b4-f3b1-4ebe-bc2a-c46ea516b9e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:48.562790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9e57b5b4-f3b1-4ebe-bc2a-c46ea516b9e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:48.592263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9e57b5b4-f3b1-4ebe-bc2a-c46ea516b9e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042769 Nov 08 17:46:48.592808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 722/1468] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:48.869489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-253996d9-5869-45a6-85f7-c418e9ba64c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:48.870549 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-253996d9-5869-45a6-85f7-c418e9ba64c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:48.877265 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-253996d9-5869-45a6-85f7-c418e9ba64c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:48.877703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-253996d9-5869-45a6-85f7-c418e9ba64c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:48.878488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-253996d9-5869-45a6-85f7-c418e9ba64c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:48.878926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-253996d9-5869-45a6-85f7-c418e9ba64c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:48.907047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-253996d9-5869-45a6-85f7-c418e9ba64c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041916 Nov 08 17:46:48.907583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 747/1469] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:49.490549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-32d9ab90-82ef-42e7-93bc-db88cb2050ab tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec251940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:49.535399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-32d9ab90-82ef-42e7-93bc-db88cb2050ab tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048620 Nov 08 17:46:49.535967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 723/1470] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:49 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:49.604387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e4c7345d-6628-44cb-b970-d3f20ba7684e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:49.605382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e4c7345d-6628-44cb-b970-d3f20ba7684e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:49.611564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e4c7345d-6628-44cb-b970-d3f20ba7684e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:49.612015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e4c7345d-6628-44cb-b970-d3f20ba7684e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:49.612790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e4c7345d-6628-44cb-b970-d3f20ba7684e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:49.613493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e4c7345d-6628-44cb-b970-d3f20ba7684e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:49.641708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e4c7345d-6628-44cb-b970-d3f20ba7684e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042026 Nov 08 17:46:49.642256 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 748/1471] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:49.918263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-38cac617-f717-4f9b-a3a9-f692a3125f44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:49.919179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-38cac617-f717-4f9b-a3a9-f692a3125f44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:49.925024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38cac617-f717-4f9b-a3a9-f692a3125f44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:49.925465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38cac617-f717-4f9b-a3a9-f692a3125f44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:49.926235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38cac617-f717-4f9b-a3a9-f692a3125f44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:49.926691 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38cac617-f717-4f9b-a3a9-f692a3125f44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:49.954973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-38cac617-f717-4f9b-a3a9-f692a3125f44 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041138 Nov 08 17:46:49.955515 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 724/1472] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:50.547485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ed876f00-494d-4905-97c2-b8e942a41806 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c040>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:50.591808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ed876f00-494d-4905-97c2-b8e942a41806 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047838 Nov 08 17:46:50.592365 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 749/1473] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:50 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:50.652905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5c4b392d-f6a6-4678-9f73-2e873f2510e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:50.653817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5c4b392d-f6a6-4678-9f73-2e873f2510e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:50.659565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c4b392d-f6a6-4678-9f73-2e873f2510e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:50.660011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c4b392d-f6a6-4678-9f73-2e873f2510e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:50.660784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c4b392d-f6a6-4678-9f73-2e873f2510e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:50.661213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c4b392d-f6a6-4678-9f73-2e873f2510e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:50.692908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5c4b392d-f6a6-4678-9f73-2e873f2510e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Nov 08 17:46:50.693455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 725/1474] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:50.967541 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b03ea05c-6a99-4a9d-b160-c91a2db06809 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:50.968460 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b03ea05c-6a99-4a9d-b160-c91a2db06809 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:50.975108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b03ea05c-6a99-4a9d-b160-c91a2db06809 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:50.975552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b03ea05c-6a99-4a9d-b160-c91a2db06809 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:50.977434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b03ea05c-6a99-4a9d-b160-c91a2db06809 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:50.978569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b03ea05c-6a99-4a9d-b160-c91a2db06809 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:51.008356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b03ea05c-6a99-4a9d-b160-c91a2db06809 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045214 Nov 08 17:46:51.009144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 750/1475] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:51.603999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-017d2756-dd2d-48f8-b3d2-5d71be177b29 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec22e310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:51.650338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-017d2756-dd2d-48f8-b3d2-5d71be177b29 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049773 Nov 08 17:46:51.654563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 726/1476] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:51 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:51.704670 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-26607085-7083-4c3a-955f-f2e0c4a9d5cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:51.705669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-26607085-7083-4c3a-955f-f2e0c4a9d5cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:51.711636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26607085-7083-4c3a-955f-f2e0c4a9d5cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:51.712220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26607085-7083-4c3a-955f-f2e0c4a9d5cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:51.713017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26607085-7083-4c3a-955f-f2e0c4a9d5cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:51.713659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26607085-7083-4c3a-955f-f2e0c4a9d5cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:51.743833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-26607085-7083-4c3a-955f-f2e0c4a9d5cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042726 Nov 08 17:46:51.744487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 751/1477] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:52.020187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c0e6b2d3-245a-42de-92a5-83f7e168de26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:52.021091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c0e6b2d3-245a-42de-92a5-83f7e168de26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:52.027679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0e6b2d3-245a-42de-92a5-83f7e168de26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:52.028126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0e6b2d3-245a-42de-92a5-83f7e168de26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:52.028894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0e6b2d3-245a-42de-92a5-83f7e168de26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:52.029324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0e6b2d3-245a-42de-92a5-83f7e168de26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:52.057504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c0e6b2d3-245a-42de-92a5-83f7e168de26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041063 Nov 08 17:46:52.058053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 727/1478] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:52.664193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-326b82c8-b292-400e-8ac9-747ed6eea473 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec23b430>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:52.711066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-326b82c8-b292-400e-8ac9-747ed6eea473 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050406 Nov 08 17:46:52.717242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 752/1479] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:52 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:52.755469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0b8740d4-8f7c-4ed7-9528-b94a13272808 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:52.756366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0b8740d4-8f7c-4ed7-9528-b94a13272808 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:52.763077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b8740d4-8f7c-4ed7-9528-b94a13272808 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:52.763516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b8740d4-8f7c-4ed7-9528-b94a13272808 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:52.764347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b8740d4-8f7c-4ed7-9528-b94a13272808 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:52.764945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b8740d4-8f7c-4ed7-9528-b94a13272808 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:52.795425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0b8740d4-8f7c-4ed7-9528-b94a13272808 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Nov 08 17:46:52.796009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 728/1480] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:53.068461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-97056f0d-3c42-4ee2-92a7-3c7187a9ab7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:53.069384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-97056f0d-3c42-4ee2-92a7-3c7187a9ab7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:53.076605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97056f0d-3c42-4ee2-92a7-3c7187a9ab7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:53.080861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97056f0d-3c42-4ee2-92a7-3c7187a9ab7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:53.080861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97056f0d-3c42-4ee2-92a7-3c7187a9ab7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:53.080861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-97056f0d-3c42-4ee2-92a7-3c7187a9ab7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:53.106225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-97056f0d-3c42-4ee2-92a7-3c7187a9ab7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041477 Nov 08 17:46:53.106813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 753/1481] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:53.723625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6da754cc-98ba-4dec-a606-67e6db4334c4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec240e50>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:53.768828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6da754cc-98ba-4dec-a606-67e6db4334c4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048737 Nov 08 17:46:53.773651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 729/1482] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:53 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:53.813356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1ef18fba-feae-47f7-bba2-6f25e9e18cc6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:53.814269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1ef18fba-feae-47f7-bba2-6f25e9e18cc6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:53.820701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ef18fba-feae-47f7-bba2-6f25e9e18cc6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:53.821156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ef18fba-feae-47f7-bba2-6f25e9e18cc6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:53.822011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ef18fba-feae-47f7-bba2-6f25e9e18cc6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:53.822708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ef18fba-feae-47f7-bba2-6f25e9e18cc6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:53.851244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1ef18fba-feae-47f7-bba2-6f25e9e18cc6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Nov 08 17:46:53.851827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 754/1483] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:54.117934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4a0a307a-120b-4af0-a36a-10c44653e803 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:54.118915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4a0a307a-120b-4af0-a36a-10c44653e803 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:54.125433 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a0a307a-120b-4af0-a36a-10c44653e803 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:54.125871 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a0a307a-120b-4af0-a36a-10c44653e803 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:54.126660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a0a307a-120b-4af0-a36a-10c44653e803 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:54.127088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a0a307a-120b-4af0-a36a-10c44653e803 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:54.155478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4a0a307a-120b-4af0-a36a-10c44653e803 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041317 Nov 08 17:46:54.156779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 730/1484] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:54.780460 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5c38fbb2-ab36-4be1-91d9-af5d01a3bf7b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25caf0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:54.827585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5c38fbb2-ab36-4be1-91d9-af5d01a3bf7b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050701 Nov 08 17:46:54.832562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 755/1485] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:54 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:54.868135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-baedc676-0fb5-4c4e-88e0-beb49c0e2cac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:54.868135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-baedc676-0fb5-4c4e-88e0-beb49c0e2cac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:54.872505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-baedc676-0fb5-4c4e-88e0-beb49c0e2cac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:54.872972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-baedc676-0fb5-4c4e-88e0-beb49c0e2cac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:54.873748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-baedc676-0fb5-4c4e-88e0-beb49c0e2cac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:54.874172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-baedc676-0fb5-4c4e-88e0-beb49c0e2cac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:54.904329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-baedc676-0fb5-4c4e-88e0-beb49c0e2cac tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Nov 08 17:46:54.904899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 731/1486] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:55.168365 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-eb2b807e-443c-4125-a196-26fd2cf298de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:55.169298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-eb2b807e-443c-4125-a196-26fd2cf298de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:55.175671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eb2b807e-443c-4125-a196-26fd2cf298de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:55.176115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eb2b807e-443c-4125-a196-26fd2cf298de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:55.176884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eb2b807e-443c-4125-a196-26fd2cf298de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:55.177316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eb2b807e-443c-4125-a196-26fd2cf298de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:55.205653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-eb2b807e-443c-4125-a196-26fd2cf298de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041554 Nov 08 17:46:55.206205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 756/1487] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:55.840380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ffd6783a-6ac8-4c30-b9b9-226c07fda23e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e24c0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:55.886032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ffd6783a-6ac8-4c30-b9b9-226c07fda23e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049662 Nov 08 17:46:55.886993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 732/1488] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:55 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:55.916708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fd922a1d-5c40-4a6d-98ea-1daa03c09880 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:55.917786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fd922a1d-5c40-4a6d-98ea-1daa03c09880 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:55.928167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd922a1d-5c40-4a6d-98ea-1daa03c09880 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:55.928605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd922a1d-5c40-4a6d-98ea-1daa03c09880 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:55.929379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd922a1d-5c40-4a6d-98ea-1daa03c09880 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:55.929805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd922a1d-5c40-4a6d-98ea-1daa03c09880 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:55.958769 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fd922a1d-5c40-4a6d-98ea-1daa03c09880 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046653 Nov 08 17:46:55.959366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 757/1489] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:56.216931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-04562d9b-0477-427c-9a64-b0e9f56802ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:56.217746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-04562d9b-0477-427c-9a64-b0e9f56802ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:56.224240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04562d9b-0477-427c-9a64-b0e9f56802ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:56.224686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04562d9b-0477-427c-9a64-b0e9f56802ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:56.225446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04562d9b-0477-427c-9a64-b0e9f56802ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:56.225879 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04562d9b-0477-427c-9a64-b0e9f56802ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:56.254057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-04562d9b-0477-427c-9a64-b0e9f56802ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041011 Nov 08 17:46:56.254624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 733/1490] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:56.898292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-060da5a5-014b-4787-a7a0-d6946cf508c4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec378dc0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:56.943313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-060da5a5-014b-4787-a7a0-d6946cf508c4 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048546 Nov 08 17:46:56.948228 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 758/1491] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:56 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:56.969540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-464f2bd6-e0ae-447d-bee1-1734031d6b7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:56.970474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-464f2bd6-e0ae-447d-bee1-1734031d6b7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:56.976654 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-464f2bd6-e0ae-447d-bee1-1734031d6b7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:56.977097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-464f2bd6-e0ae-447d-bee1-1734031d6b7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:56.978661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-464f2bd6-e0ae-447d-bee1-1734031d6b7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:56.979180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-464f2bd6-e0ae-447d-bee1-1734031d6b7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:57.010575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-464f2bd6-e0ae-447d-bee1-1734031d6b7d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Nov 08 17:46:57.011132 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 734/1492] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:57.266101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-39c5b9ef-79e6-4e84-b99d-4b1e9496c7c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:57.266962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-39c5b9ef-79e6-4e84-b99d-4b1e9496c7c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:57.273552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39c5b9ef-79e6-4e84-b99d-4b1e9496c7c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:57.273998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39c5b9ef-79e6-4e84-b99d-4b1e9496c7c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:57.275546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39c5b9ef-79e6-4e84-b99d-4b1e9496c7c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:57.275989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39c5b9ef-79e6-4e84-b99d-4b1e9496c7c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:57.303789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-39c5b9ef-79e6-4e84-b99d-4b1e9496c7c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041580 Nov 08 17:46:57.304337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 759/1493] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:57.955581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a3ff4591-56bd-45fa-8bc6-e763d4e79d7f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec263d30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:58.001553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a3ff4591-56bd-45fa-8bc6-e763d4e79d7f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049475 Nov 08 17:46:58.002337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 735/1494] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:57 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:58.020809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0f0458f8-57cc-4e24-ab92-88b2249787dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:58.021761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0f0458f8-57cc-4e24-ab92-88b2249787dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:58.028664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f0458f8-57cc-4e24-ab92-88b2249787dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:58.029119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f0458f8-57cc-4e24-ab92-88b2249787dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:58.029897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f0458f8-57cc-4e24-ab92-88b2249787dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:58.030331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f0458f8-57cc-4e24-ab92-88b2249787dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:58.059372 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0f0458f8-57cc-4e24-ab92-88b2249787dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042200 Nov 08 17:46:58.059943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 760/1495] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:58.315400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5a26f94a-9c53-4445-9441-ce9d12cf620b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:58.316346 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5a26f94a-9c53-4445-9441-ce9d12cf620b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:58.323009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a26f94a-9c53-4445-9441-ce9d12cf620b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:58.323469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a26f94a-9c53-4445-9441-ce9d12cf620b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:58.324226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a26f94a-9c53-4445-9441-ce9d12cf620b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:58.324655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a26f94a-9c53-4445-9441-ce9d12cf620b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:58.352577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5a26f94a-9c53-4445-9441-ce9d12cf620b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041023 Nov 08 17:46:58.353119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 736/1496] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:46:59.013396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4130e786-f49a-4149-ac87-8340c1c18253 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373160>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:59.057861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4130e786-f49a-4149-ac87-8340c1c18253 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048560 Nov 08 17:46:59.058545 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 761/1497] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:46:59 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:59.070408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8f66a521-6301-41a6-ba98-c747c0dc2aa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:59.072043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8f66a521-6301-41a6-ba98-c747c0dc2aa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:59.078808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f66a521-6301-41a6-ba98-c747c0dc2aa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:59.079250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f66a521-6301-41a6-ba98-c747c0dc2aa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:59.080009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f66a521-6301-41a6-ba98-c747c0dc2aa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:59.080435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f66a521-6301-41a6-ba98-c747c0dc2aa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:59.108800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8f66a521-6301-41a6-ba98-c747c0dc2aa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Nov 08 17:46:59.109643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 737/1498] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:46:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:46:59.363803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b2db362c-09b6-47c2-83e0-d8f520767a91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:46:59.364701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b2db362c-09b6-47c2-83e0-d8f520767a91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:46:59.372817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b2db362c-09b6-47c2-83e0-d8f520767a91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:59.373262 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b2db362c-09b6-47c2-83e0-d8f520767a91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:59.374025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b2db362c-09b6-47c2-83e0-d8f520767a91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:46:59.374477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b2db362c-09b6-47c2-83e0-d8f520767a91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:46:59.402328 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b2db362c-09b6-47c2-83e0-d8f520767a91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042545 Nov 08 17:46:59.402895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 762/1499] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:46:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:00.069800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5aed0ae1-bce0-47bb-9367-4748b9724317 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24b3a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:00.115187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5aed0ae1-bce0-47bb-9367-4748b9724317 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049018 Nov 08 17:47:00.118518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 738/1500] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:00 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:00.120135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c4f9a34e-a10d-4481-8c24-c1ed1159ad9a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:00.121108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c4f9a34e-a10d-4481-8c24-c1ed1159ad9a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:00.127219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4f9a34e-a10d-4481-8c24-c1ed1159ad9a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:00.127663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4f9a34e-a10d-4481-8c24-c1ed1159ad9a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:00.128429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4f9a34e-a10d-4481-8c24-c1ed1159ad9a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:00.128857 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4f9a34e-a10d-4481-8c24-c1ed1159ad9a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:00.162804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c4f9a34e-a10d-4481-8c24-c1ed1159ad9a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Nov 08 17:47:00.165470 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 763/1501] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:00.414488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-194a03d8-aab6-4c50-b472-9b48bf1b0910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:00.415432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-194a03d8-aab6-4c50-b472-9b48bf1b0910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:00.421929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-194a03d8-aab6-4c50-b472-9b48bf1b0910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:00.422367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-194a03d8-aab6-4c50-b472-9b48bf1b0910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:00.423219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-194a03d8-aab6-4c50-b472-9b48bf1b0910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:00.423646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-194a03d8-aab6-4c50-b472-9b48bf1b0910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:00.451376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-194a03d8-aab6-4c50-b472-9b48bf1b0910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040864 Nov 08 17:47:00.451925 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 739/1502] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:01.128205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a82e700e-5e28-4114-8014-e56a107bf086 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3354c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:01.172980 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a82e700e-5e28-4114-8014-e56a107bf086 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048354 Nov 08 17:47:01.173536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 764/1503] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:01 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:01.176857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ce6dd6cd-5205-4e37-a3b5-286f1141fcb6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:01.177788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ce6dd6cd-5205-4e37-a3b5-286f1141fcb6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:01.184574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6cd-5205-4e37-a3b5-286f1141fcb6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:01.185018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6cd-5205-4e37-a3b5-286f1141fcb6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:01.185781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6cd-5205-4e37-a3b5-286f1141fcb6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:01.186210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce6dd6cd-5205-4e37-a3b5-286f1141fcb6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:01.214090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ce6dd6cd-5205-4e37-a3b5-286f1141fcb6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 Nov 08 17:47:01.214670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 740/1504] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:01.463751 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0ea783c4-8fe0-4fa8-8fc8-c8cdff0e7eaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:01.464673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0ea783c4-8fe0-4fa8-8fc8-c8cdff0e7eaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:01.471163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ea783c4-8fe0-4fa8-8fc8-c8cdff0e7eaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:01.471603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ea783c4-8fe0-4fa8-8fc8-c8cdff0e7eaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:01.472364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ea783c4-8fe0-4fa8-8fc8-c8cdff0e7eaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:01.472789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ea783c4-8fe0-4fa8-8fc8-c8cdff0e7eaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:01.501314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0ea783c4-8fe0-4fa8-8fc8-c8cdff0e7eaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042011 Nov 08 17:47:01.501787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 765/1505] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:02.185083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2ffd18a9-256f-422b-b209-39fbd7256acb tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e20d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:02.225303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-aa72e8f6-d536-4fd8-8f51-a9b95ac16695 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:02.226213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-aa72e8f6-d536-4fd8-8f51-a9b95ac16695 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:02.233367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aa72e8f6-d536-4fd8-8f51-a9b95ac16695 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:02.233819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aa72e8f6-d536-4fd8-8f51-a9b95ac16695 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:02.234673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aa72e8f6-d536-4fd8-8f51-a9b95ac16695 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:02.235147 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aa72e8f6-d536-4fd8-8f51-a9b95ac16695 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:02.241220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2ffd18a9-256f-422b-b209-39fbd7256acb tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.058487 Nov 08 17:47:02.241890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 741/1506] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:02 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:02.266312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-aa72e8f6-d536-4fd8-8f51-a9b95ac16695 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Nov 08 17:47:02.266895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 766/1507] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:02.512901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3c1ed922-4a1c-4c86-a6ec-82c5271a725a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:02.513750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3c1ed922-4a1c-4c86-a6ec-82c5271a725a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:02.520607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c1ed922-4a1c-4c86-a6ec-82c5271a725a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:02.521054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c1ed922-4a1c-4c86-a6ec-82c5271a725a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:02.521826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c1ed922-4a1c-4c86-a6ec-82c5271a725a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:02.522257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c1ed922-4a1c-4c86-a6ec-82c5271a725a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:02.552052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3c1ed922-4a1c-4c86-a6ec-82c5271a725a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043685 Nov 08 17:47:02.552609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 742/1508] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:03.255056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c00abf4b-2096-4190-82b4-4ba0ba6c14ad tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec23bf70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:03.277480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e1e4c0a2-08fa-4262-aa28-f3f76a88997a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:03.278377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e1e4c0a2-08fa-4262-aa28-f3f76a88997a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:03.284495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1e4c0a2-08fa-4262-aa28-f3f76a88997a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:03.284951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1e4c0a2-08fa-4262-aa28-f3f76a88997a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:03.285736 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1e4c0a2-08fa-4262-aa28-f3f76a88997a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:03.286172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1e4c0a2-08fa-4262-aa28-f3f76a88997a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:03.301643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c00abf4b-2096-4190-82b4-4ba0ba6c14ad tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050241 Nov 08 17:47:03.302218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 767/1509] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:03 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:03.314400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e1e4c0a2-08fa-4262-aa28-f3f76a88997a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041151 Nov 08 17:47:03.314974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 743/1510] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:03.563634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-92b7c761-ed2b-4d9a-a042-a06f6d9c8873 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:03.564491 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-92b7c761-ed2b-4d9a-a042-a06f6d9c8873 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:03.570957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-92b7c761-ed2b-4d9a-a042-a06f6d9c8873 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:03.572223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-92b7c761-ed2b-4d9a-a042-a06f6d9c8873 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:03.573017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-92b7c761-ed2b-4d9a-a042-a06f6d9c8873 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:03.573449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-92b7c761-ed2b-4d9a-a042-a06f6d9c8873 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:03.600815 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-92b7c761-ed2b-4d9a-a042-a06f6d9c8873 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040974 Nov 08 17:47:03.601354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 768/1511] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:04.313204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-435b6982-04df-41f8-a8a2-0eed753b5e6f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1c6dc0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:04.326033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1be6cba6-1d48-463a-a8e9-cae139741ddc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:04.326689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1be6cba6-1d48-463a-a8e9-cae139741ddc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:04.332548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1be6cba6-1d48-463a-a8e9-cae139741ddc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:04.332994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1be6cba6-1d48-463a-a8e9-cae139741ddc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:04.333771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1be6cba6-1d48-463a-a8e9-cae139741ddc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:04.334209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1be6cba6-1d48-463a-a8e9-cae139741ddc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:04.359066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-435b6982-04df-41f8-a8a2-0eed753b5e6f tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049410 Nov 08 17:47:04.359743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 744/1512] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:04 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:04.363978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1be6cba6-1d48-463a-a8e9-cae139741ddc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Nov 08 17:47:04.364535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 769/1513] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:04.612261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7220c4d8-afe5-42d7-869a-2505f4404484 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:04.613406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7220c4d8-afe5-42d7-869a-2505f4404484 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:04.619965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7220c4d8-afe5-42d7-869a-2505f4404484 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:04.620406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7220c4d8-afe5-42d7-869a-2505f4404484 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:04.621165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7220c4d8-afe5-42d7-869a-2505f4404484 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:04.621596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7220c4d8-afe5-42d7-869a-2505f4404484 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:04.649140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7220c4d8-afe5-42d7-869a-2505f4404484 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040613 Nov 08 17:47:04.650366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 745/1514] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:05.372132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-293866c6-f6b5-4802-b3bc-81a7109a887e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3c3430>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:05.374935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-72e708f4-5f10-458b-a5ae-539f21f02f88 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:05.375837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-72e708f4-5f10-458b-a5ae-539f21f02f88 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:05.382134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-72e708f4-5f10-458b-a5ae-539f21f02f88 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:05.382608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-72e708f4-5f10-458b-a5ae-539f21f02f88 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:05.383377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-72e708f4-5f10-458b-a5ae-539f21f02f88 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:05.384506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-72e708f4-5f10-458b-a5ae-539f21f02f88 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:05.413880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-72e708f4-5f10-458b-a5ae-539f21f02f88 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 Nov 08 17:47:05.414439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 746/1515] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:05.418866 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-293866c6-f6b5-4802-b3bc-81a7109a887e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050802 Nov 08 17:47:05.419458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 770/1516] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:05 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:05.661152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-facd4c78-bf14-4bf5-8791-59885dcb8bb5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:05.662044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-facd4c78-bf14-4bf5-8791-59885dcb8bb5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:05.667928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-facd4c78-bf14-4bf5-8791-59885dcb8bb5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:05.668370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-facd4c78-bf14-4bf5-8791-59885dcb8bb5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:05.669272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-facd4c78-bf14-4bf5-8791-59885dcb8bb5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:05.669702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-facd4c78-bf14-4bf5-8791-59885dcb8bb5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:05.698697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-facd4c78-bf14-4bf5-8791-59885dcb8bb5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041424 Nov 08 17:47:05.699241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 747/1517] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:06.426356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cb0270e8-2e41-4c1c-a1c3-137a1bfe5bc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:06.427291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cb0270e8-2e41-4c1c-a1c3-137a1bfe5bc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:06.431286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9fd826db-3239-409f-b823-b376f3e83bed tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec279790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:06.434605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb0270e8-2e41-4c1c-a1c3-137a1bfe5bc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:06.435053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb0270e8-2e41-4c1c-a1c3-137a1bfe5bc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:06.435852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb0270e8-2e41-4c1c-a1c3-137a1bfe5bc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:06.436283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb0270e8-2e41-4c1c-a1c3-137a1bfe5bc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:06.464626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cb0270e8-2e41-4c1c-a1c3-137a1bfe5bc9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 Nov 08 17:47:06.465326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 771/1518] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:06.476195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9fd826db-3239-409f-b823-b376f3e83bed tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049020 Nov 08 17:47:06.476842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 748/1519] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:06 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:06.710225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-abfc3027-3050-4afb-a676-9c28811fe9e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:06.711154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-abfc3027-3050-4afb-a676-9c28811fe9e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:06.717546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abfc3027-3050-4afb-a676-9c28811fe9e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:06.717933 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abfc3027-3050-4afb-a676-9c28811fe9e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:06.718731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abfc3027-3050-4afb-a676-9c28811fe9e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:06.719160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abfc3027-3050-4afb-a676-9c28811fe9e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:06.747717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-abfc3027-3050-4afb-a676-9c28811fe9e9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041199 Nov 08 17:47:06.748264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 772/1520] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:07.476031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-22135b3c-a0dd-4bdd-90ae-1cddb25182d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:07.476936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-22135b3c-a0dd-4bdd-90ae-1cddb25182d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:07.484057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-22135b3c-a0dd-4bdd-90ae-1cddb25182d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:07.484507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-22135b3c-a0dd-4bdd-90ae-1cddb25182d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:07.485283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-22135b3c-a0dd-4bdd-90ae-1cddb25182d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:07.485749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-22135b3c-a0dd-4bdd-90ae-1cddb25182d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:07.488563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-73944d64-7ef0-4325-93c9-ea4a24920d0c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25c820>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:07.516471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-22135b3c-a0dd-4bdd-90ae-1cddb25182d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 Nov 08 17:47:07.517033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 749/1521] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:07.534826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-73944d64-7ef0-4325-93c9-ea4a24920d0c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049987 Nov 08 17:47:07.535394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 773/1522] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:07 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:07.760821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0dbb5e3b-6c56-4c0c-9206-b9840636c0e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:07.760821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0dbb5e3b-6c56-4c0c-9206-b9840636c0e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:07.765711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0dbb5e3b-6c56-4c0c-9206-b9840636c0e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:07.766159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0dbb5e3b-6c56-4c0c-9206-b9840636c0e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:07.766949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0dbb5e3b-6c56-4c0c-9206-b9840636c0e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:07.767379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0dbb5e3b-6c56-4c0c-9206-b9840636c0e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:07.795716 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0dbb5e3b-6c56-4c0c-9206-b9840636c0e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040348 Nov 08 17:47:07.796260 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 750/1523] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:08.528945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3f32630d-ff72-4879-bd9f-5f716bbccb24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:08.529838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3f32630d-ff72-4879-bd9f-5f716bbccb24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:08.537703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f32630d-ff72-4879-bd9f-5f716bbccb24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:08.538147 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f32630d-ff72-4879-bd9f-5f716bbccb24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:08.538941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f32630d-ff72-4879-bd9f-5f716bbccb24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:08.539372 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f32630d-ff72-4879-bd9f-5f716bbccb24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:08.546966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ec7a46c2-f993-40b9-815c-a0f4ae5340ed tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e2940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:08.567921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3f32630d-ff72-4879-bd9f-5f716bbccb24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Nov 08 17:47:08.568493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 774/1524] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:08.592474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ec7a46c2-f993-40b9-815c-a0f4ae5340ed tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049147 Nov 08 17:47:08.593034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 751/1525] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:08 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:08.807570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f86568b8-d86a-4cb1-99ed-5c5ed8f2c5cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:08.808467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f86568b8-d86a-4cb1-99ed-5c5ed8f2c5cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:08.814235 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f86568b8-d86a-4cb1-99ed-5c5ed8f2c5cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:08.814724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f86568b8-d86a-4cb1-99ed-5c5ed8f2c5cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:08.815519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f86568b8-d86a-4cb1-99ed-5c5ed8f2c5cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:08.815949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f86568b8-d86a-4cb1-99ed-5c5ed8f2c5cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:08.843972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f86568b8-d86a-4cb1-99ed-5c5ed8f2c5cd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040767 Nov 08 17:47:08.844517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 775/1526] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:09.454333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:47:09.454566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 17:47:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:47:09.580443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-969a9ecc-7359-4c65-8443-310906fe538c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:09.581257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-969a9ecc-7359-4c65-8443-310906fe538c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:09.588364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-969a9ecc-7359-4c65-8443-310906fe538c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:09.588891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-969a9ecc-7359-4c65-8443-310906fe538c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:09.589656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-969a9ecc-7359-4c65-8443-310906fe538c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:09.590081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-969a9ecc-7359-4c65-8443-310906fe538c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:09.604919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7cf08959-55d8-4c05-a9e2-54e66fefb416 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec23b700>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:09.619857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-969a9ecc-7359-4c65-8443-310906fe538c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Nov 08 17:47:09.620423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 752/1527] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:09.651927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7cf08959-55d8-4c05-a9e2-54e66fefb416 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051080 Nov 08 17:47:09.652488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 776/1528] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:09 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:09.855782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9d49595d-0ac7-473a-af82-d270014026d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:09.856724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9d49595d-0ac7-473a-af82-d270014026d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:09.862413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d49595d-0ac7-473a-af82-d270014026d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:09.863129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d49595d-0ac7-473a-af82-d270014026d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:09.863884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d49595d-0ac7-473a-af82-d270014026d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:09.864310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d49595d-0ac7-473a-af82-d270014026d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:09.892156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9d49595d-0ac7-473a-af82-d270014026d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040738 Nov 08 17:47:09.892693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 753/1529] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:10.631771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4b55f9f1-bf21-4127-afd0-6d86db1b98f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:10.632674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4b55f9f1-bf21-4127-afd0-6d86db1b98f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:10.640024 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b55f9f1-bf21-4127-afd0-6d86db1b98f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:10.640471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b55f9f1-bf21-4127-afd0-6d86db1b98f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:10.641245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b55f9f1-bf21-4127-afd0-6d86db1b98f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:10.641680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b55f9f1-bf21-4127-afd0-6d86db1b98f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:10.670959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4b55f9f1-bf21-4127-afd0-6d86db1b98f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Nov 08 17:47:10.671537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 777/1530] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:10.711244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0700c3c6-aad3-451a-91d5-99ca9c0615d7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2633a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:10.755445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0700c3c6-aad3-451a-91d5-99ca9c0615d7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.095763 Nov 08 17:47:10.756013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 754/1531] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:10 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:10.903952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-27f02b89-bc02-4adc-b4b9-80dd4dda788d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:10.904889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-27f02b89-bc02-4adc-b4b9-80dd4dda788d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:10.910626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27f02b89-bc02-4adc-b4b9-80dd4dda788d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:10.911070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27f02b89-bc02-4adc-b4b9-80dd4dda788d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:10.911835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27f02b89-bc02-4adc-b4b9-80dd4dda788d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:10.912263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27f02b89-bc02-4adc-b4b9-80dd4dda788d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:10.940775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-27f02b89-bc02-4adc-b4b9-80dd4dda788d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041264 Nov 08 17:47:10.941309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 778/1532] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:11.683682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5462e0c5-2e5e-4888-8f8c-a7d4b4727e17 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:11.684571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5462e0c5-2e5e-4888-8f8c-a7d4b4727e17 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:11.691195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5462e0c5-2e5e-4888-8f8c-a7d4b4727e17 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:11.691634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5462e0c5-2e5e-4888-8f8c-a7d4b4727e17 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:11.692387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5462e0c5-2e5e-4888-8f8c-a7d4b4727e17 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:11.692810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5462e0c5-2e5e-4888-8f8c-a7d4b4727e17 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:11.722980 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5462e0c5-2e5e-4888-8f8c-a7d4b4727e17 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Nov 08 17:47:11.723945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 755/1533] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:11.768795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8bee8617-b6d9-486e-9798-85784bac457d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b2820>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:11.818841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8bee8617-b6d9-486e-9798-85784bac457d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053631 Nov 08 17:47:11.824920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 779/1534] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:11 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:11.973895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a5c7e87c-00e4-4f4e-9712-56be7d940011 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:11.973895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a5c7e87c-00e4-4f4e-9712-56be7d940011 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:11.973895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a5c7e87c-00e4-4f4e-9712-56be7d940011 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:11.973895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a5c7e87c-00e4-4f4e-9712-56be7d940011 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:11.974479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a5c7e87c-00e4-4f4e-9712-56be7d940011 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:11.974479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a5c7e87c-00e4-4f4e-9712-56be7d940011 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:11.990543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a5c7e87c-00e4-4f4e-9712-56be7d940011 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041844 Nov 08 17:47:11.991101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 756/1535] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:12.734207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-741c41a9-be6f-47cf-9568-33d13793331b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:12.735144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-741c41a9-be6f-47cf-9568-33d13793331b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:12.741986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-741c41a9-be6f-47cf-9568-33d13793331b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:12.742432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-741c41a9-be6f-47cf-9568-33d13793331b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:12.743247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-741c41a9-be6f-47cf-9568-33d13793331b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:12.743677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-741c41a9-be6f-47cf-9568-33d13793331b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:12.771572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-741c41a9-be6f-47cf-9568-33d13793331b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040949 Nov 08 17:47:12.772175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 780/1536] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:12.831440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0adbcea0-008c-4d5f-ac29-228f8745e2a6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec22e5e0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:12.876678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0adbcea0-008c-4d5f-ac29-228f8745e2a6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048862 Nov 08 17:47:12.877317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 757/1537] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:13.002452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a6d876e7-9008-44c3-91f4-372033afaa2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:13.003380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a6d876e7-9008-44c3-91f4-372033afaa2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:13.010572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a6d876e7-9008-44c3-91f4-372033afaa2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:13.011011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a6d876e7-9008-44c3-91f4-372033afaa2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:13.011773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a6d876e7-9008-44c3-91f4-372033afaa2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:13.012201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a6d876e7-9008-44c3-91f4-372033afaa2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:13.039963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a6d876e7-9008-44c3-91f4-372033afaa2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041309 Nov 08 17:47:13.040573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 781/1538] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:13.783596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-81717c7d-1fa4-4a7e-94c1-e1b2ad0df45e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:13.784502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-81717c7d-1fa4-4a7e-94c1-e1b2ad0df45e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:13.791546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81717c7d-1fa4-4a7e-94c1-e1b2ad0df45e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:13.791988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81717c7d-1fa4-4a7e-94c1-e1b2ad0df45e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:13.792785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81717c7d-1fa4-4a7e-94c1-e1b2ad0df45e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:13.793219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81717c7d-1fa4-4a7e-94c1-e1b2ad0df45e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:13.822841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-81717c7d-1fa4-4a7e-94c1-e1b2ad0df45e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043014 Nov 08 17:47:13.823461 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 758/1539] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:13.889402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a4bddd72-a8e5-4d29-8260-b8606baa6c7a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373af0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:13.933599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a4bddd72-a8e5-4d29-8260-b8606baa6c7a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047683 Nov 08 17:47:13.934164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 782/1540] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:13 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:14.051465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-97994d9d-df68-41b5-91c7-c02d646af0c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:14.052294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-97994d9d-df68-41b5-91c7-c02d646af0c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:14.059126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-97994d9d-df68-41b5-91c7-c02d646af0c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:14.059563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-97994d9d-df68-41b5-91c7-c02d646af0c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:14.060320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-97994d9d-df68-41b5-91c7-c02d646af0c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:14.060745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-97994d9d-df68-41b5-91c7-c02d646af0c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:14.088080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-97994d9d-df68-41b5-91c7-c02d646af0c8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040470 Nov 08 17:47:14.088612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 759/1541] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:14.834554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-719f8d7e-5166-41a6-9f3e-dfc433cb65ea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:14.835410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-719f8d7e-5166-41a6-9f3e-dfc433cb65ea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:14.842779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-719f8d7e-5166-41a6-9f3e-dfc433cb65ea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:14.843232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-719f8d7e-5166-41a6-9f3e-dfc433cb65ea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:14.844012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-719f8d7e-5166-41a6-9f3e-dfc433cb65ea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:14.844449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-719f8d7e-5166-41a6-9f3e-dfc433cb65ea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:14.872571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-719f8d7e-5166-41a6-9f3e-dfc433cb65ea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Nov 08 17:47:14.873126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 783/1542] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:14.944883 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-287b2623-4329-41ce-b547-35ddc4f04085 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e2e50>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:14.989882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-287b2623-4329-41ce-b547-35ddc4f04085 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048489 Nov 08 17:47:14.990478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 760/1543] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:14 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:15.098854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-576b29bb-a067-4924-828f-b3665ceb72bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:15.099691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-576b29bb-a067-4924-828f-b3665ceb72bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:15.105680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-576b29bb-a067-4924-828f-b3665ceb72bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:15.106134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-576b29bb-a067-4924-828f-b3665ceb72bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:15.106952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-576b29bb-a067-4924-828f-b3665ceb72bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:15.107393 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-576b29bb-a067-4924-828f-b3665ceb72bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:15.135908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-576b29bb-a067-4924-828f-b3665ceb72bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040771 Nov 08 17:47:15.136449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 784/1544] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:15.884468 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e981a2a9-ef0a-4206-9485-c0cbae6f54bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:15.885367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e981a2a9-ef0a-4206-9485-c0cbae6f54bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:15.891890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e981a2a9-ef0a-4206-9485-c0cbae6f54bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:15.892334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e981a2a9-ef0a-4206-9485-c0cbae6f54bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:15.893100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e981a2a9-ef0a-4206-9485-c0cbae6f54bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:15.893530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e981a2a9-ef0a-4206-9485-c0cbae6f54bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:15.921155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e981a2a9-ef0a-4206-9485-c0cbae6f54bd tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041054 Nov 08 17:47:15.921701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 761/1545] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:16.002096 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-40ec67c8-809b-4f85-9e25-38e713b1c330 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3349d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:16.047102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-40ec67c8-809b-4f85-9e25-38e713b1c330 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048585 Nov 08 17:47:16.047662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 785/1546] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:15 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:16.147514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-777746e1-7c35-483c-ae33-e1c14bfe96db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:16.148350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-777746e1-7c35-483c-ae33-e1c14bfe96db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:16.154960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-777746e1-7c35-483c-ae33-e1c14bfe96db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:16.155399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-777746e1-7c35-483c-ae33-e1c14bfe96db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:16.156154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-777746e1-7c35-483c-ae33-e1c14bfe96db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:16.156579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-777746e1-7c35-483c-ae33-e1c14bfe96db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:16.184607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-777746e1-7c35-483c-ae33-e1c14bfe96db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041116 Nov 08 17:47:16.185142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 762/1547] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:16.932187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-26a71154-1bbe-48ae-8320-d36cf2ab4168 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:16.933097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-26a71154-1bbe-48ae-8320-d36cf2ab4168 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:16.940968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26a71154-1bbe-48ae-8320-d36cf2ab4168 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:16.941412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26a71154-1bbe-48ae-8320-d36cf2ab4168 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:16.942183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26a71154-1bbe-48ae-8320-d36cf2ab4168 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:16.942642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26a71154-1bbe-48ae-8320-d36cf2ab4168 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:16.970369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-26a71154-1bbe-48ae-8320-d36cf2ab4168 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Nov 08 17:47:16.970945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 786/1548] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:17.059264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-38e11aae-1851-4734-ae59-a4050e9cbb37 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec263160>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:17.104252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-38e11aae-1851-4734-ae59-a4050e9cbb37 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049167 Nov 08 17:47:17.104814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 763/1549] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:17 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:17.195887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f33fbc64-f3db-4b3a-a2a8-f91d26c0edaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:17.197402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f33fbc64-f3db-4b3a-a2a8-f91d26c0edaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:17.203625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f33fbc64-f3db-4b3a-a2a8-f91d26c0edaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:17.204074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f33fbc64-f3db-4b3a-a2a8-f91d26c0edaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:17.204871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f33fbc64-f3db-4b3a-a2a8-f91d26c0edaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:17.205307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f33fbc64-f3db-4b3a-a2a8-f91d26c0edaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:17.234467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f33fbc64-f3db-4b3a-a2a8-f91d26c0edaf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042350 Nov 08 17:47:17.236160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 787/1550] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:17.981765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fcd008d1-aa05-447d-88cb-e25903b3cacb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:17.982705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fcd008d1-aa05-447d-88cb-e25903b3cacb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:17.989746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fcd008d1-aa05-447d-88cb-e25903b3cacb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:17.990326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fcd008d1-aa05-447d-88cb-e25903b3cacb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:17.991142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fcd008d1-aa05-447d-88cb-e25903b3cacb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:17.992031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fcd008d1-aa05-447d-88cb-e25903b3cacb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:18.019965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fcd008d1-aa05-447d-88cb-e25903b3cacb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042672 Nov 08 17:47:18.020513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 764/1551] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:18.116604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bd6006e7-5e18-4a5a-ba56-be85364772ea tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b2b80>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:18.162152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bd6006e7-5e18-4a5a-ba56-be85364772ea tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049355 Nov 08 17:47:18.162773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 788/1552] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:18 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:18.247218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d571e0ec-3a5a-4e23-ab87-7af8ea6cd175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:18.248141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d571e0ec-3a5a-4e23-ab87-7af8ea6cd175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:18.254383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d571e0ec-3a5a-4e23-ab87-7af8ea6cd175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:18.254862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d571e0ec-3a5a-4e23-ab87-7af8ea6cd175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:18.255640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d571e0ec-3a5a-4e23-ab87-7af8ea6cd175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:18.256107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d571e0ec-3a5a-4e23-ab87-7af8ea6cd175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:18.284440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d571e0ec-3a5a-4e23-ab87-7af8ea6cd175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042000 Nov 08 17:47:18.285023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 765/1553] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:19.032052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3f6ed813-7254-496b-993c-32cf670ae313 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:19.032953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3f6ed813-7254-496b-993c-32cf670ae313 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:19.039492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f6ed813-7254-496b-993c-32cf670ae313 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:19.039942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f6ed813-7254-496b-993c-32cf670ae313 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:19.041339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f6ed813-7254-496b-993c-32cf670ae313 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:19.041773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f6ed813-7254-496b-993c-32cf670ae313 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:19.069019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3f6ed813-7254-496b-993c-32cf670ae313 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 Nov 08 17:47:19.069558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 789/1554] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:19.174976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-57bc4220-109c-47e8-89e8-3d73756bad49 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1ec550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:19.219796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-57bc4220-109c-47e8-89e8-3d73756bad49 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048260 Nov 08 17:47:19.220363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 766/1555] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:19 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:19.295789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a9aec4c8-e51b-4f65-a9b8-e08108fe3467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:19.296693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a9aec4c8-e51b-4f65-a9b8-e08108fe3467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:19.302317 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a9aec4c8-e51b-4f65-a9b8-e08108fe3467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:19.302790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a9aec4c8-e51b-4f65-a9b8-e08108fe3467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:19.303650 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a9aec4c8-e51b-4f65-a9b8-e08108fe3467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:19.303968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a9aec4c8-e51b-4f65-a9b8-e08108fe3467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:19.333087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a9aec4c8-e51b-4f65-a9b8-e08108fe3467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041079 Nov 08 17:47:19.333635 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 790/1556] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:20.081042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-648ca923-e4ad-47ec-b68a-b5be0840888a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:20.082000 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-648ca923-e4ad-47ec-b68a-b5be0840888a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:20.088803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-648ca923-e4ad-47ec-b68a-b5be0840888a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:20.089245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-648ca923-e4ad-47ec-b68a-b5be0840888a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:20.090011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-648ca923-e4ad-47ec-b68a-b5be0840888a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:20.090443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-648ca923-e4ad-47ec-b68a-b5be0840888a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:20.119636 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-648ca923-e4ad-47ec-b68a-b5be0840888a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Nov 08 17:47:20.119940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 767/1557] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:20.232376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-32326ed2-f7f5-4d97-a58c-e8b8a261ae00 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec334040>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:20.277418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-32326ed2-f7f5-4d97-a58c-e8b8a261ae00 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049403 Nov 08 17:47:20.277976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 791/1558] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:20 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:20.343929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ed91f474-07c3-4a4d-9e98-b271f4831a60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:20.344946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ed91f474-07c3-4a4d-9e98-b271f4831a60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:20.350662 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed91f474-07c3-4a4d-9e98-b271f4831a60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:20.351114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed91f474-07c3-4a4d-9e98-b271f4831a60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:20.351959 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed91f474-07c3-4a4d-9e98-b271f4831a60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:20.352399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ed91f474-07c3-4a4d-9e98-b271f4831a60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:20.382618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ed91f474-07c3-4a4d-9e98-b271f4831a60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042489 Nov 08 17:47:20.383169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 768/1559] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:21.130062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f2384696-9abc-4608-bc0c-3c08085d8d27 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:21.130998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f2384696-9abc-4608-bc0c-3c08085d8d27 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:21.138049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2384696-9abc-4608-bc0c-3c08085d8d27 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:21.138524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2384696-9abc-4608-bc0c-3c08085d8d27 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:21.139293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2384696-9abc-4608-bc0c-3c08085d8d27 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:21.139727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2384696-9abc-4608-bc0c-3c08085d8d27 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:21.167955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f2384696-9abc-4608-bc0c-3c08085d8d27 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041639 Nov 08 17:47:21.168492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 792/1560] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:21.289611 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f0279823-5494-4d63-875c-1af3938c9fd5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24b040>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:21.336044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f0279823-5494-4d63-875c-1af3938c9fd5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050077 Nov 08 17:47:21.336622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 769/1561] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:21 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:21.394898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-603b8063-6da3-499a-986a-6c4042cac89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:21.395802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-603b8063-6da3-499a-986a-6c4042cac89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:21.402517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-603b8063-6da3-499a-986a-6c4042cac89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:21.402964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-603b8063-6da3-499a-986a-6c4042cac89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:21.403740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-603b8063-6da3-499a-986a-6c4042cac89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:21.404206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-603b8063-6da3-499a-986a-6c4042cac89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:21.433353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-603b8063-6da3-499a-986a-6c4042cac89a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042241 Nov 08 17:47:21.433896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 793/1562] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:22.179109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-754905ca-da6e-4bc1-a53e-48c575d409fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:22.180033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-754905ca-da6e-4bc1-a53e-48c575d409fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:22.187145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754905ca-da6e-4bc1-a53e-48c575d409fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:22.187585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754905ca-da6e-4bc1-a53e-48c575d409fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:22.188343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754905ca-da6e-4bc1-a53e-48c575d409fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:22.188772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754905ca-da6e-4bc1-a53e-48c575d409fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:22.217506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-754905ca-da6e-4bc1-a53e-48c575d409fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Nov 08 17:47:22.218043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 770/1563] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:22.348929 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d4848a19-1b21-4eec-b0f9-4f6322e84031 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec335d30>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:22.394388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d4848a19-1b21-4eec-b0f9-4f6322e84031 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049071 Nov 08 17:47:22.394986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 794/1564] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:22 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:22.444554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4b167bd0-af3c-4f44-a658-f7991de17ed5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:22.445462 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4b167bd0-af3c-4f44-a658-f7991de17ed5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:22.451843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b167bd0-af3c-4f44-a658-f7991de17ed5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:22.452288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b167bd0-af3c-4f44-a658-f7991de17ed5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:22.453071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b167bd0-af3c-4f44-a658-f7991de17ed5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:22.453505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b167bd0-af3c-4f44-a658-f7991de17ed5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:22.482517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4b167bd0-af3c-4f44-a658-f7991de17ed5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041602 Nov 08 17:47:22.483743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 771/1565] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:23.228554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ecb73ea6-abdf-4b71-b039-2dfe62a68a4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:23.229455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ecb73ea6-abdf-4b71-b039-2dfe62a68a4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:23.235981 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecb73ea6-abdf-4b71-b039-2dfe62a68a4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:23.236424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecb73ea6-abdf-4b71-b039-2dfe62a68a4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:23.237182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecb73ea6-abdf-4b71-b039-2dfe62a68a4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:23.237865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ecb73ea6-abdf-4b71-b039-2dfe62a68a4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:23.266250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ecb73ea6-abdf-4b71-b039-2dfe62a68a4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Nov 08 17:47:23.266758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 795/1566] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:23.406992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8195a3a3-0f5e-4943-ab32-2324999ab1f3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec384670>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:23.451652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8195a3a3-0f5e-4943-ab32-2324999ab1f3 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048224 Nov 08 17:47:23.457721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 772/1567] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:23 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:23.496662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-12bf9520-3d94-4f25-a033-41d765589273 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:23.497566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-12bf9520-3d94-4f25-a033-41d765589273 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:23.503676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12bf9520-3d94-4f25-a033-41d765589273 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:23.504217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12bf9520-3d94-4f25-a033-41d765589273 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:23.505622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12bf9520-3d94-4f25-a033-41d765589273 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:23.506014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12bf9520-3d94-4f25-a033-41d765589273 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:23.535124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-12bf9520-3d94-4f25-a033-41d765589273 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042839 Nov 08 17:47:23.535756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 796/1568] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:24.278105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6693b589-49a6-41ef-b9e7-ac7154b36fa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:24.278979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6693b589-49a6-41ef-b9e7-ac7154b36fa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:24.285469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6693b589-49a6-41ef-b9e7-ac7154b36fa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:24.285923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6693b589-49a6-41ef-b9e7-ac7154b36fa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:24.286720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6693b589-49a6-41ef-b9e7-ac7154b36fa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:24.287152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6693b589-49a6-41ef-b9e7-ac7154b36fa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:24.315249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6693b589-49a6-41ef-b9e7-ac7154b36fa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041495 Nov 08 17:47:24.315789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 773/1569] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:24.463987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-898d8c0e-a091-43a3-95de-a4c126bac858 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3b2940>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:24.509976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-898d8c0e-a091-43a3-95de-a4c126bac858 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049330 Nov 08 17:47:24.510646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 797/1570] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:24 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:24.547375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-81b59b87-02d4-44c4-abb2-06a5f3d3da17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:24.547991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-81b59b87-02d4-44c4-abb2-06a5f3d3da17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:24.554093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81b59b87-02d4-44c4-abb2-06a5f3d3da17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:24.554572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81b59b87-02d4-44c4-abb2-06a5f3d3da17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:24.555357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81b59b87-02d4-44c4-abb2-06a5f3d3da17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:24.555788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81b59b87-02d4-44c4-abb2-06a5f3d3da17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:24.586392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-81b59b87-02d4-44c4-abb2-06a5f3d3da17 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043334 Nov 08 17:47:24.586983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 774/1571] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:25.327245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-22f6c368-12ef-4a6d-a06a-0b5c23472f3c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:25.328112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-22f6c368-12ef-4a6d-a06a-0b5c23472f3c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:25.335885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22f6c368-12ef-4a6d-a06a-0b5c23472f3c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:25.336320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22f6c368-12ef-4a6d-a06a-0b5c23472f3c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:25.337084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22f6c368-12ef-4a6d-a06a-0b5c23472f3c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:25.337612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22f6c368-12ef-4a6d-a06a-0b5c23472f3c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:25.366135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-22f6c368-12ef-4a6d-a06a-0b5c23472f3c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043428 Nov 08 17:47:25.366700 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 798/1572] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:25.521904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4674624c-9ab0-40c0-b635-96ee14b8426e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec263160>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:25.566687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4674624c-9ab0-40c0-b635-96ee14b8426e tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048288 Nov 08 17:47:25.567472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 775/1573] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:25 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:25.598647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-49763887-b651-4888-b989-9f606e80441d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:25.599791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-49763887-b651-4888-b989-9f606e80441d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:25.606146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-49763887-b651-4888-b989-9f606e80441d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:25.606620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-49763887-b651-4888-b989-9f606e80441d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:25.607391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-49763887-b651-4888-b989-9f606e80441d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:25.607822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-49763887-b651-4888-b989-9f606e80441d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:25.638046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-49763887-b651-4888-b989-9f606e80441d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043298 Nov 08 17:47:25.638632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 799/1574] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:26.378266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ce532481-28b0-4b03-b908-b631d56ec1f5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:26.379237 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ce532481-28b0-4b03-b908-b631d56ec1f5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:26.385940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce532481-28b0-4b03-b908-b631d56ec1f5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:26.386390 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce532481-28b0-4b03-b908-b631d56ec1f5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:26.387194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce532481-28b0-4b03-b908-b631d56ec1f5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:26.387633 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce532481-28b0-4b03-b908-b631d56ec1f5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:26.416085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ce532481-28b0-4b03-b908-b631d56ec1f5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041032 Nov 08 17:47:26.416647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 776/1575] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:26.578725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e9ff84f4-7b6a-44b6-adc5-92c7ea145704 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b2a60>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:26.624903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e9ff84f4-7b6a-44b6-adc5-92c7ea145704 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049732 Nov 08 17:47:26.625813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 800/1576] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:26 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:26.656349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-70ee3946-390b-4e21-ac21-40c01e77d845 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:26.657423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-70ee3946-390b-4e21-ac21-40c01e77d845 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:26.663822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-70ee3946-390b-4e21-ac21-40c01e77d845 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:26.664278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-70ee3946-390b-4e21-ac21-40c01e77d845 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:26.665060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-70ee3946-390b-4e21-ac21-40c01e77d845 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:26.666172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-70ee3946-390b-4e21-ac21-40c01e77d845 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:26.694599 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-70ee3946-390b-4e21-ac21-40c01e77d845 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041942 Nov 08 17:47:26.695173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 777/1577] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:27.427315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-103dcdde-72fb-4315-baa1-e626abcb15df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:27.428226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-103dcdde-72fb-4315-baa1-e626abcb15df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:27.435446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-103dcdde-72fb-4315-baa1-e626abcb15df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:27.435901 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-103dcdde-72fb-4315-baa1-e626abcb15df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:27.436673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-103dcdde-72fb-4315-baa1-e626abcb15df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:27.437108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-103dcdde-72fb-4315-baa1-e626abcb15df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:27.464965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-103dcdde-72fb-4315-baa1-e626abcb15df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041413 Nov 08 17:47:27.465498 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 801/1578] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:27.636988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5a031376-7ed5-47c8-85a8-703d37d5cc74 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24b790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:27.682159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5a031376-7ed5-47c8-85a8-703d37d5cc74 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048909 Nov 08 17:47:27.683027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 778/1579] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:27 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:27.705297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ca227ecc-9f6f-4bb4-a469-55197aefeeda tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:27.706195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ca227ecc-9f6f-4bb4-a469-55197aefeeda tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:27.712082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca227ecc-9f6f-4bb4-a469-55197aefeeda tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:27.712678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca227ecc-9f6f-4bb4-a469-55197aefeeda tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:27.713547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca227ecc-9f6f-4bb4-a469-55197aefeeda tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:27.713957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca227ecc-9f6f-4bb4-a469-55197aefeeda tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:27.744552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ca227ecc-9f6f-4bb4-a469-55197aefeeda tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042239 Nov 08 17:47:27.745115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 802/1580] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:28.476470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4216ca85-5490-49a5-8436-625eca50892a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:28.477365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4216ca85-5490-49a5-8436-625eca50892a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:28.483986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4216ca85-5490-49a5-8436-625eca50892a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:28.484423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4216ca85-5490-49a5-8436-625eca50892a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:28.485182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4216ca85-5490-49a5-8436-625eca50892a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:28.485608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4216ca85-5490-49a5-8436-625eca50892a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:28.513480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4216ca85-5490-49a5-8436-625eca50892a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040810 Nov 08 17:47:28.514027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 779/1581] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:28.693239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-56dd6176-da5c-415d-80c6-3a51e6531132 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b2b80>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:28.739935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-56dd6176-da5c-415d-80c6-3a51e6531132 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050291 Nov 08 17:47:28.745445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 803/1582] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:28 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:28.756141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ad8b8e59-57c5-4fef-a5ef-8c0ed64153b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:28.757017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ad8b8e59-57c5-4fef-a5ef-8c0ed64153b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:28.763794 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad8b8e59-57c5-4fef-a5ef-8c0ed64153b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:28.764233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad8b8e59-57c5-4fef-a5ef-8c0ed64153b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:28.764991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad8b8e59-57c5-4fef-a5ef-8c0ed64153b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:28.765420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad8b8e59-57c5-4fef-a5ef-8c0ed64153b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:28.799510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ad8b8e59-57c5-4fef-a5ef-8c0ed64153b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047017 Nov 08 17:47:28.800070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 780/1583] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:29.528285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-96dd92de-62d7-49ac-8e49-bca9f0c2e38c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:29.529201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-96dd92de-62d7-49ac-8e49-bca9f0c2e38c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:29.535805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-96dd92de-62d7-49ac-8e49-bca9f0c2e38c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:29.536255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-96dd92de-62d7-49ac-8e49-bca9f0c2e38c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:29.537043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-96dd92de-62d7-49ac-8e49-bca9f0c2e38c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:29.537479 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-96dd92de-62d7-49ac-8e49-bca9f0c2e38c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:29.566144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-96dd92de-62d7-49ac-8e49-bca9f0c2e38c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Nov 08 17:47:29.566727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 804/1584] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:29.752792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-051d261f-b17e-44dd-a068-2c1d4cfcc7d9 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e3310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:29.798878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-051d261f-b17e-44dd-a068-2c1d4cfcc7d9 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049655 Nov 08 17:47:29.799503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 781/1585] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:29 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:29.810659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-27cbcd11-a9ca-4961-ab7a-8c9985440e2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:29.812096 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-27cbcd11-a9ca-4961-ab7a-8c9985440e2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:29.818214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27cbcd11-a9ca-4961-ab7a-8c9985440e2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:29.818697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27cbcd11-a9ca-4961-ab7a-8c9985440e2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:29.819476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27cbcd11-a9ca-4961-ab7a-8c9985440e2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:29.819910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27cbcd11-a9ca-4961-ab7a-8c9985440e2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:29.849433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-27cbcd11-a9ca-4961-ab7a-8c9985440e2f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042495 Nov 08 17:47:29.849995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 805/1586] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:30.577481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2ac4c913-2b06-4e82-950f-516bd276af51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:30.578380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2ac4c913-2b06-4e82-950f-516bd276af51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:30.586026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ac4c913-2b06-4e82-950f-516bd276af51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:30.586500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ac4c913-2b06-4e82-950f-516bd276af51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:30.587285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ac4c913-2b06-4e82-950f-516bd276af51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:30.587721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2ac4c913-2b06-4e82-950f-516bd276af51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:30.615890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2ac4c913-2b06-4e82-950f-516bd276af51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Nov 08 17:47:30.616438 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 782/1587] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:30.811790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2a2498d9-c1b6-428a-bbec-7c6a13e697cd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373550>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:30.856459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2a2498d9-c1b6-428a-bbec-7c6a13e697cd tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048183 Nov 08 17:47:30.857418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 806/1588] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:30 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:30.865039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7b6265b0-a3e0-40ef-8178-799004c3f07e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:30.866015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7b6265b0-a3e0-40ef-8178-799004c3f07e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:30.872314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b6265b0-a3e0-40ef-8178-799004c3f07e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:30.872758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b6265b0-a3e0-40ef-8178-799004c3f07e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:30.873531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b6265b0-a3e0-40ef-8178-799004c3f07e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:30.873964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b6265b0-a3e0-40ef-8178-799004c3f07e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:30.902822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7b6265b0-a3e0-40ef-8178-799004c3f07e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046067 Nov 08 17:47:30.903388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 783/1589] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:31.627811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ac3d9878-a552-47da-9f08-62706138002e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:31.628719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ac3d9878-a552-47da-9f08-62706138002e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:31.636066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac3d9878-a552-47da-9f08-62706138002e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:31.636620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac3d9878-a552-47da-9f08-62706138002e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:31.637396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac3d9878-a552-47da-9f08-62706138002e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:31.637830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac3d9878-a552-47da-9f08-62706138002e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:31.665224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ac3d9878-a552-47da-9f08-62706138002e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041242 Nov 08 17:47:31.665778 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 807/1590] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:31.868973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c9cf09c3-5370-40a3-83c6-7a8c5acc4ed9 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec229940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:31.914207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-02dbfc85-75b2-49b9-be8f-8800c774e1fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:31.914809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c9cf09c3-5370-40a3-83c6-7a8c5acc4ed9 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049385 Nov 08 17:47:31.915150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-02dbfc85-75b2-49b9-be8f-8800c774e1fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:31.919963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 784/1591] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:31 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:31.921763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02dbfc85-75b2-49b9-be8f-8800c774e1fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:31.922209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02dbfc85-75b2-49b9-be8f-8800c774e1fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:31.923022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02dbfc85-75b2-49b9-be8f-8800c774e1fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:31.923457 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02dbfc85-75b2-49b9-be8f-8800c774e1fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:31.953973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-02dbfc85-75b2-49b9-be8f-8800c774e1fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043582 Nov 08 17:47:31.955781 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 808/1592] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:47:32.676455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ee1fa546-a64f-4481-8242-d503157ee8e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:32.677301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ee1fa546-a64f-4481-8242-d503157ee8e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:32.683864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee1fa546-a64f-4481-8242-d503157ee8e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:32.684300 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee1fa546-a64f-4481-8242-d503157ee8e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:32.685063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee1fa546-a64f-4481-8242-d503157ee8e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:32.685494 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee1fa546-a64f-4481-8242-d503157ee8e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:32.712695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ee1fa546-a64f-4481-8242-d503157ee8e1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040088 Nov 08 17:47:32.713231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 785/1593] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:32.926200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-33bfdc2a-f7ad-44ff-945c-2daf033ebd57 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec574280>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:32.965753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8ba4d378-04ae-4272-a9e6-4924c52c2ba0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:32.967229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8ba4d378-04ae-4272-a9e6-4924c52c2ba0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:32.973111 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ba4d378-04ae-4272-a9e6-4924c52c2ba0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:32.973557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ba4d378-04ae-4272-a9e6-4924c52c2ba0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:32.973783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-33bfdc2a-f7ad-44ff-945c-2daf033ebd57 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051159 Nov 08 17:47:32.974530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ba4d378-04ae-4272-a9e6-4924c52c2ba0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:32.974811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 809/1594] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:32 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:32.978944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ba4d378-04ae-4272-a9e6-4924c52c2ba0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:33.009568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8ba4d378-04ae-4272-a9e6-4924c52c2ba0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047449 Nov 08 17:47:33.013116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 786/1595] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:47:33.724835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8b16abb5-a9a1-431d-be46-2b79416d953d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:33.725770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8b16abb5-a9a1-431d-be46-2b79416d953d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:33.734692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b16abb5-a9a1-431d-be46-2b79416d953d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:33.735152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b16abb5-a9a1-431d-be46-2b79416d953d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:33.735927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b16abb5-a9a1-431d-be46-2b79416d953d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:33.736366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b16abb5-a9a1-431d-be46-2b79416d953d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:33.765209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8b16abb5-a9a1-431d-be46-2b79416d953d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Nov 08 17:47:33.765750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 810/1596] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:33.985593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-eb746143-9bf2-44a1-900a-5f911b9ad059 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e30d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:34.020570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c49f308a-bb48-424f-bc40-3b22595fb111 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:34.021525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c49f308a-bb48-424f-bc40-3b22595fb111 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:34.028249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c49f308a-bb48-424f-bc40-3b22595fb111 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:34.028696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c49f308a-bb48-424f-bc40-3b22595fb111 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:34.029508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c49f308a-bb48-424f-bc40-3b22595fb111 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:34.029943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c49f308a-bb48-424f-bc40-3b22595fb111 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:34.035367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-eb746143-9bf2-44a1-900a-5f911b9ad059 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053208 Nov 08 17:47:34.036142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 787/1597] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:33 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:34.060035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c49f308a-bb48-424f-bc40-3b22595fb111 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043293 Nov 08 17:47:34.060598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 811/1598] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:47:34.775817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-49c8f468-1244-4020-b22e-1244bb9b01b0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:34.776722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-49c8f468-1244-4020-b22e-1244bb9b01b0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:34.783311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49c8f468-1244-4020-b22e-1244bb9b01b0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:34.783794 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49c8f468-1244-4020-b22e-1244bb9b01b0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:34.784563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49c8f468-1244-4020-b22e-1244bb9b01b0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:34.784994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-49c8f468-1244-4020-b22e-1244bb9b01b0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:34.812685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-49c8f468-1244-4020-b22e-1244bb9b01b0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040611 Nov 08 17:47:34.813227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 788/1599] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:35.056802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4f2b2761-796c-49e3-8692-df0b48b40cc7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373ca0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:35.071138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-14ba4fd5-9c9a-433b-8505-32c550231c53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:35.072050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-14ba4fd5-9c9a-433b-8505-32c550231c53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:35.078117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14ba4fd5-9c9a-433b-8505-32c550231c53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:35.078591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14ba4fd5-9c9a-433b-8505-32c550231c53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:35.079361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14ba4fd5-9c9a-433b-8505-32c550231c53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:35.079787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14ba4fd5-9c9a-433b-8505-32c550231c53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:35.102557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4f2b2761-796c-49e3-8692-df0b48b40cc7 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049426 Nov 08 17:47:35.103384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 812/1600] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:35 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:35.113301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-14ba4fd5-9c9a-433b-8505-32c550231c53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045779 Nov 08 17:47:35.113870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 789/1601] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:47:35.824953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c98859cf-020b-4569-9d83-c71e4f263b32 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:35.829606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c98859cf-020b-4569-9d83-c71e4f263b32 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:35.832502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c98859cf-020b-4569-9d83-c71e4f263b32 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:35.832965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c98859cf-020b-4569-9d83-c71e4f263b32 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:35.833776 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c98859cf-020b-4569-9d83-c71e4f263b32 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:35.834205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c98859cf-020b-4569-9d83-c71e4f263b32 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:35.864012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c98859cf-020b-4569-9d83-c71e4f263b32 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Nov 08 17:47:35.864564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 813/1602] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:36.115814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6e21f622-7fa9-4e98-bf17-be38ab529617 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec25f940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:36.125096 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6e722951-ad9e-4f3a-ae00-21ccfa1764de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:36.126150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6e722951-ad9e-4f3a-ae00-21ccfa1764de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:36.132699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6e722951-ad9e-4f3a-ae00-21ccfa1764de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:36.133141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6e722951-ad9e-4f3a-ae00-21ccfa1764de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:36.133951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6e722951-ad9e-4f3a-ae00-21ccfa1764de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:36.134381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6e722951-ad9e-4f3a-ae00-21ccfa1764de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:36.167647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6e21f622-7fa9-4e98-bf17-be38ab529617 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053284 Nov 08 17:47:36.167762 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6e722951-ad9e-4f3a-ae00-21ccfa1764de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044904 Nov 08 17:47:36.167860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 790/1603] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:36 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:36.167946 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 814/1604] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:47:36.876065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-27722ff3-124b-492b-b6af-54b31f833e77 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:36.876970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-27722ff3-124b-492b-b6af-54b31f833e77 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:36.883374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-27722ff3-124b-492b-b6af-54b31f833e77 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:36.883815 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-27722ff3-124b-492b-b6af-54b31f833e77 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:36.884568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-27722ff3-124b-492b-b6af-54b31f833e77 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:36.884992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-27722ff3-124b-492b-b6af-54b31f833e77 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:36.912514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-27722ff3-124b-492b-b6af-54b31f833e77 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040187 Nov 08 17:47:36.913053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 791/1605] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:37.177885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a7afb3e7-fd27-488a-9c7c-e64d8f99fa95 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec279790>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:37.178536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8264d753-6977-45b5-a022-a90812eca93c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:37.178914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8264d753-6977-45b5-a022-a90812eca93c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:37.186927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8264d753-6977-45b5-a022-a90812eca93c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:37.187404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8264d753-6977-45b5-a022-a90812eca93c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:37.188159 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8264d753-6977-45b5-a022-a90812eca93c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:37.188590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8264d753-6977-45b5-a022-a90812eca93c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:37.218585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8264d753-6977-45b5-a022-a90812eca93c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044465 Nov 08 17:47:37.219320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 815/1606] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:37.224045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a7afb3e7-fd27-488a-9c7c-e64d8f99fa95 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049904 Nov 08 17:47:37.224755 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 792/1607] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:37 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:37.923862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-38fd3d7c-b2d1-4c76-8c35-12f058f7554f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:37.924773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-38fd3d7c-b2d1-4c76-8c35-12f058f7554f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:37.930742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38fd3d7c-b2d1-4c76-8c35-12f058f7554f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:37.931193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38fd3d7c-b2d1-4c76-8c35-12f058f7554f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:37.931983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38fd3d7c-b2d1-4c76-8c35-12f058f7554f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:37.932423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38fd3d7c-b2d1-4c76-8c35-12f058f7554f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:37.960034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-38fd3d7c-b2d1-4c76-8c35-12f058f7554f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039944 Nov 08 17:47:37.960568 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 816/1608] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:38.230389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8f3752b9-e3c9-4fc1-a341-85b030f0fb80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:38.231388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8f3752b9-e3c9-4fc1-a341-85b030f0fb80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:38.236033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-67756eaa-394c-4957-9aa5-23f4d5eb82af tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec24a790>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:38.237505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f3752b9-e3c9-4fc1-a341-85b030f0fb80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:38.237950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f3752b9-e3c9-4fc1-a341-85b030f0fb80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:38.238740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f3752b9-e3c9-4fc1-a341-85b030f0fb80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:38.239162 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8f3752b9-e3c9-4fc1-a341-85b030f0fb80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:38.269916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8f3752b9-e3c9-4fc1-a341-85b030f0fb80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043993 Nov 08 17:47:38.270652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 793/1609] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:38.283140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-67756eaa-394c-4957-9aa5-23f4d5eb82af tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050628 Nov 08 17:47:38.283716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 817/1610] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:38 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:38.971785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-025cc9ea-5a79-4465-bca0-4e055c048bff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:38.972702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-025cc9ea-5a79-4465-bca0-4e055c048bff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:38.978427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-025cc9ea-5a79-4465-bca0-4e055c048bff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:38.979463 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-025cc9ea-5a79-4465-bca0-4e055c048bff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:38.980321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-025cc9ea-5a79-4465-bca0-4e055c048bff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:38.980748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-025cc9ea-5a79-4465-bca0-4e055c048bff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:39.162902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-025cc9ea-5a79-4465-bca0-4e055c048bff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194742 Nov 08 17:47:39.163481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 794/1611] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:39.282375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c624a783-0a83-45d1-ba24-58baffb1a183 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:39.283215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c624a783-0a83-45d1-ba24-58baffb1a183 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:39.289811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c624a783-0a83-45d1-ba24-58baffb1a183 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:39.290253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c624a783-0a83-45d1-ba24-58baffb1a183 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:39.291042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c624a783-0a83-45d1-ba24-58baffb1a183 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:39.292087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c624a783-0a83-45d1-ba24-58baffb1a183 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:39.295741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-88404a2e-7ea5-4cb3-96f4-eec279b1b057 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e8700>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:39.320326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c624a783-0a83-45d1-ba24-58baffb1a183 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042315 Nov 08 17:47:39.320874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 818/1612] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:47:39.344842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-88404a2e-7ea5-4cb3-96f4-eec279b1b057 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050764 Nov 08 17:47:39.344842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 795/1613] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:39 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:40.175250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-60e2f9d0-6227-4cf3-9cd4-ddc0a0490d95 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:40.176188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-60e2f9d0-6227-4cf3-9cd4-ddc0a0490d95 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:40.181963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60e2f9d0-6227-4cf3-9cd4-ddc0a0490d95 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:40.182399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60e2f9d0-6227-4cf3-9cd4-ddc0a0490d95 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:40.183186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60e2f9d0-6227-4cf3-9cd4-ddc0a0490d95 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:40.183615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60e2f9d0-6227-4cf3-9cd4-ddc0a0490d95 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:40.211295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-60e2f9d0-6227-4cf3-9cd4-ddc0a0490d95 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039788 Nov 08 17:47:40.211830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 819/1614] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:40.332702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8bf8cab9-1a70-4259-a19b-fddbef823eaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:40.333527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8bf8cab9-1a70-4259-a19b-fddbef823eaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:40.340424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8bf8cab9-1a70-4259-a19b-fddbef823eaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:40.340867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8bf8cab9-1a70-4259-a19b-fddbef823eaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:40.341641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8bf8cab9-1a70-4259-a19b-fddbef823eaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:40.342081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8bf8cab9-1a70-4259-a19b-fddbef823eaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:40.354510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6e9d321a-6a0d-4f80-a643-a2d7206330cf tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2b2a60>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:40.370542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8bf8cab9-1a70-4259-a19b-fddbef823eaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042181 Nov 08 17:47:40.371263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 796/1615] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:40.400340 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6e9d321a-6a0d-4f80-a643-a2d7206330cf tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049400 Nov 08 17:47:40.401575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 820/1616] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:40 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:41.223180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d7849eca-492e-48c7-b615-bae225d89141 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:41.224105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d7849eca-492e-48c7-b615-bae225d89141 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:41.230448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7849eca-492e-48c7-b615-bae225d89141 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:41.230918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7849eca-492e-48c7-b615-bae225d89141 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:41.231688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7849eca-492e-48c7-b615-bae225d89141 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:41.232118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7849eca-492e-48c7-b615-bae225d89141 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:41.260661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d7849eca-492e-48c7-b615-bae225d89141 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041177 Nov 08 17:47:41.261132 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 797/1617] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:41.382262 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fdd7b0b4-433c-49e7-b196-e39034565745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:41.383182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fdd7b0b4-433c-49e7-b196-e39034565745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:41.389973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdd7b0b4-433c-49e7-b196-e39034565745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:41.390420 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdd7b0b4-433c-49e7-b196-e39034565745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:41.391219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdd7b0b4-433c-49e7-b196-e39034565745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:41.391656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdd7b0b4-433c-49e7-b196-e39034565745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:41.412708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0b5534ef-e969-483d-910d-a44f32259fd2 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e2ca0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:41.422275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fdd7b0b4-433c-49e7-b196-e39034565745 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044187 Nov 08 17:47:41.423034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 821/1618] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:41.460147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0b5534ef-e969-483d-910d-a44f32259fd2 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050927 Nov 08 17:47:41.460704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 798/1619] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:41 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:42.271681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7548eb35-9637-4444-a965-01f535e3f537 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:42.272510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7548eb35-9637-4444-a965-01f535e3f537 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:42.278640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7548eb35-9637-4444-a965-01f535e3f537 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:42.279084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7548eb35-9637-4444-a965-01f535e3f537 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:42.279846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7548eb35-9637-4444-a965-01f535e3f537 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:42.280270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7548eb35-9637-4444-a965-01f535e3f537 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:42.308444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7548eb35-9637-4444-a965-01f535e3f537 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040631 Nov 08 17:47:42.308978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 822/1620] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:42.434743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-232657d0-1365-43d9-93d7-af6ed6e2c6f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:42.435696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-232657d0-1365-43d9-93d7-af6ed6e2c6f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:42.442406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-232657d0-1365-43d9-93d7-af6ed6e2c6f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:42.442878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-232657d0-1365-43d9-93d7-af6ed6e2c6f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:42.443665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-232657d0-1365-43d9-93d7-af6ed6e2c6f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:42.444090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-232657d0-1365-43d9-93d7-af6ed6e2c6f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:42.472055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-232657d0-1365-43d9-93d7-af6ed6e2c6f0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042009 Nov 08 17:47:42.472595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 799/1621] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:42.473150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-62fe6b08-325a-4cfe-ad06-6d24f1596d98 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373550>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:42.518630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-62fe6b08-325a-4cfe-ad06-6d24f1596d98 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048962 Nov 08 17:47:42.519224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 823/1622] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:42 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:43.319746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0b7ca9b5-15f7-44af-acdf-ce5fc340838f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:43.320563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0b7ca9b5-15f7-44af-acdf-ce5fc340838f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:43.327270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b7ca9b5-15f7-44af-acdf-ce5fc340838f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:43.327710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b7ca9b5-15f7-44af-acdf-ce5fc340838f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:43.328470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b7ca9b5-15f7-44af-acdf-ce5fc340838f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:43.328894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b7ca9b5-15f7-44af-acdf-ce5fc340838f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:43.356980 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0b7ca9b5-15f7-44af-acdf-ce5fc340838f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041121 Nov 08 17:47:43.357508 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 800/1623] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:43.483519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6acc915f-d806-49e8-95b8-4c6ea15659e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:43.484410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6acc915f-d806-49e8-95b8-4c6ea15659e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:43.491592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6acc915f-d806-49e8-95b8-4c6ea15659e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:43.492032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6acc915f-d806-49e8-95b8-4c6ea15659e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:43.492792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6acc915f-d806-49e8-95b8-4c6ea15659e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:43.493217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6acc915f-d806-49e8-95b8-4c6ea15659e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:43.520986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6acc915f-d806-49e8-95b8-4c6ea15659e3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041240 Nov 08 17:47:43.521525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 824/1624] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:43.531147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0ea4e0fc-bb2d-4916-99d4-915c027e369a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e8280>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:43.575848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0ea4e0fc-bb2d-4916-99d4-915c027e369a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048174 Nov 08 17:47:43.576403 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 801/1625] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:43 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:44.368428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-40a9a71d-5f1c-4aa2-8f27-e1b40e1f6923 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:44.370020 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-40a9a71d-5f1c-4aa2-8f27-e1b40e1f6923 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:44.375848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40a9a71d-5f1c-4aa2-8f27-e1b40e1f6923 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:44.376298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40a9a71d-5f1c-4aa2-8f27-e1b40e1f6923 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:44.377064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40a9a71d-5f1c-4aa2-8f27-e1b40e1f6923 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:44.377497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40a9a71d-5f1c-4aa2-8f27-e1b40e1f6923 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:44.405796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-40a9a71d-5f1c-4aa2-8f27-e1b40e1f6923 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Nov 08 17:47:44.406328 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 825/1626] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:44.532444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fd96a623-4ec0-4240-b742-722158359b81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:44.533364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fd96a623-4ec0-4240-b742-722158359b81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:44.540350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd96a623-4ec0-4240-b742-722158359b81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:44.540792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd96a623-4ec0-4240-b742-722158359b81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:44.542399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd96a623-4ec0-4240-b742-722158359b81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:44.542866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd96a623-4ec0-4240-b742-722158359b81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:44.569701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fd96a623-4ec0-4240-b742-722158359b81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041077 Nov 08 17:47:44.570231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 802/1627] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:44.587757 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-85372b8e-00d1-4020-829c-1b3bf0ff58a6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3b20d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:44.633358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-85372b8e-00d1-4020-829c-1b3bf0ff58a6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049178 Nov 08 17:47:44.633921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 826/1628] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:44 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:45.417728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7785f819-9eea-4605-888c-b60d0c9b3334 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:45.418689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7785f819-9eea-4605-888c-b60d0c9b3334 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:45.424531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7785f819-9eea-4605-888c-b60d0c9b3334 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:45.424967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7785f819-9eea-4605-888c-b60d0c9b3334 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:45.425729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7785f819-9eea-4605-888c-b60d0c9b3334 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:45.426155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7785f819-9eea-4605-888c-b60d0c9b3334 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:45.453917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7785f819-9eea-4605-888c-b60d0c9b3334 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040630 Nov 08 17:47:45.454477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 803/1629] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:45.580885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5be7c07f-db28-4c48-8408-d1a8bc0907e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:45.581782 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5be7c07f-db28-4c48-8408-d1a8bc0907e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:45.589138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5be7c07f-db28-4c48-8408-d1a8bc0907e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:45.589721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5be7c07f-db28-4c48-8408-d1a8bc0907e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:45.590345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5be7c07f-db28-4c48-8408-d1a8bc0907e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:45.590817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5be7c07f-db28-4c48-8408-d1a8bc0907e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:45.618190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5be7c07f-db28-4c48-8408-d1a8bc0907e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041106 Nov 08 17:47:45.618763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 827/1630] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:45.645774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5e176486-4ae8-4fb2-9f81-f0083c48386a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1fae50>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:45.691551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5e176486-4ae8-4fb2-9f81-f0083c48386a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049353 Nov 08 17:47:45.692113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 804/1631] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:45 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:46.464647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b4ae9748-193f-47d1-9c90-aa34ad018ce1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:46.465603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b4ae9748-193f-47d1-9c90-aa34ad018ce1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:46.471480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4ae9748-193f-47d1-9c90-aa34ad018ce1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:46.471923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4ae9748-193f-47d1-9c90-aa34ad018ce1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:46.472682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4ae9748-193f-47d1-9c90-aa34ad018ce1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:46.473110 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4ae9748-193f-47d1-9c90-aa34ad018ce1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:46.502736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b4ae9748-193f-47d1-9c90-aa34ad018ce1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Nov 08 17:47:46.503291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 828/1632] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:46.628976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f9e15824-0cbe-43dd-a5a0-817ea75c5d81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:46.629903 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f9e15824-0cbe-43dd-a5a0-817ea75c5d81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:46.637074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9e15824-0cbe-43dd-a5a0-817ea75c5d81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:46.637512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9e15824-0cbe-43dd-a5a0-817ea75c5d81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:46.638270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9e15824-0cbe-43dd-a5a0-817ea75c5d81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:46.638720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9e15824-0cbe-43dd-a5a0-817ea75c5d81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:46.667236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f9e15824-0cbe-43dd-a5a0-817ea75c5d81 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042028 Nov 08 17:47:46.667862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 805/1633] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:46.703950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-341c5bf7-0811-4400-a888-5349242f465b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3b2940>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:46.749348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-341c5bf7-0811-4400-a888-5349242f465b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048848 Nov 08 17:47:46.749906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 829/1634] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:46 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:47.514169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-65b319fa-cc05-4ddc-a3f3-ae305d3a743d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:47.515103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-65b319fa-cc05-4ddc-a3f3-ae305d3a743d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:47.520993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-65b319fa-cc05-4ddc-a3f3-ae305d3a743d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:47.521432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-65b319fa-cc05-4ddc-a3f3-ae305d3a743d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:47.522194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-65b319fa-cc05-4ddc-a3f3-ae305d3a743d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:47.522658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-65b319fa-cc05-4ddc-a3f3-ae305d3a743d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:47.551619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-65b319fa-cc05-4ddc-a3f3-ae305d3a743d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Nov 08 17:47:47.552145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 806/1635] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:47.678625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e97ab5dd-b304-42b6-a88d-356013efb2f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:47.679525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e97ab5dd-b304-42b6-a88d-356013efb2f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:47.686205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e97ab5dd-b304-42b6-a88d-356013efb2f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:47.686688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e97ab5dd-b304-42b6-a88d-356013efb2f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:47.687457 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e97ab5dd-b304-42b6-a88d-356013efb2f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:47.687886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e97ab5dd-b304-42b6-a88d-356013efb2f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:47.716153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e97ab5dd-b304-42b6-a88d-356013efb2f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041418 Nov 08 17:47:47.716764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 830/1636] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:47.761394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4398a0cf-a702-4a07-a00d-432c41a0913d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e83a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:47.806065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4398a0cf-a702-4a07-a00d-432c41a0913d tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048951 Nov 08 17:47:47.806709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 807/1637] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:47 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:48.562916 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-892d27c6-760b-4d17-bc8c-6266ceccd44f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:48.563853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-892d27c6-760b-4d17-bc8c-6266ceccd44f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:48.569671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-892d27c6-760b-4d17-bc8c-6266ceccd44f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:48.570115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-892d27c6-760b-4d17-bc8c-6266ceccd44f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:48.570906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-892d27c6-760b-4d17-bc8c-6266ceccd44f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:48.571339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-892d27c6-760b-4d17-bc8c-6266ceccd44f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:48.600495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-892d27c6-760b-4d17-bc8c-6266ceccd44f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Nov 08 17:47:48.601042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 831/1638] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:48.726881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cbcb1abc-eff2-4f50-a3ce-b9c093c37277 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:48.727799 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cbcb1abc-eff2-4f50-a3ce-b9c093c37277 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:48.734624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cbcb1abc-eff2-4f50-a3ce-b9c093c37277 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:48.735067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cbcb1abc-eff2-4f50-a3ce-b9c093c37277 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:48.735823 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cbcb1abc-eff2-4f50-a3ce-b9c093c37277 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:48.736247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cbcb1abc-eff2-4f50-a3ce-b9c093c37277 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:48.763998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cbcb1abc-eff2-4f50-a3ce-b9c093c37277 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040857 Nov 08 17:47:48.764614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 808/1639] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:48.817644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b0a0d824-77d6-4c4a-88b7-3b3bb68c97ac tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2134c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:48.865019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b0a0d824-77d6-4c4a-88b7-3b3bb68c97ac tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050975 Nov 08 17:47:48.865614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 832/1640] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:48 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:49.611641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b482d221-1336-4398-a37c-89928703f16e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:49.612844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b482d221-1336-4398-a37c-89928703f16e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:49.619505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b482d221-1336-4398-a37c-89928703f16e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:49.620072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b482d221-1336-4398-a37c-89928703f16e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:49.620831 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b482d221-1336-4398-a37c-89928703f16e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:49.621255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b482d221-1336-4398-a37c-89928703f16e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:49.649370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b482d221-1336-4398-a37c-89928703f16e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041460 Nov 08 17:47:49.649897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 809/1641] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:49.775047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-391ba7c2-eff6-482d-8e8f-0c082039d223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:49.776175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-391ba7c2-eff6-482d-8e8f-0c082039d223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:49.782773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-391ba7c2-eff6-482d-8e8f-0c082039d223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:49.783217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-391ba7c2-eff6-482d-8e8f-0c082039d223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:49.784010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-391ba7c2-eff6-482d-8e8f-0c082039d223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:49.784435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-391ba7c2-eff6-482d-8e8f-0c082039d223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:49.813540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-391ba7c2-eff6-482d-8e8f-0c082039d223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042318 Nov 08 17:47:49.814075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 833/1642] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:49.877541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cb053f7d-281b-4f88-a8dc-db78e2f2e726 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1ecd30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:49.921933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cb053f7d-281b-4f88-a8dc-db78e2f2e726 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047952 Nov 08 17:47:49.922505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 810/1643] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:49 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:50.660715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ac6f7b66-a6d5-4c82-8f63-71a0f67d46e9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:50.661620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ac6f7b66-a6d5-4c82-8f63-71a0f67d46e9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:50.668584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac6f7b66-a6d5-4c82-8f63-71a0f67d46e9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:50.669033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac6f7b66-a6d5-4c82-8f63-71a0f67d46e9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:50.669803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac6f7b66-a6d5-4c82-8f63-71a0f67d46e9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:50.670234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac6f7b66-a6d5-4c82-8f63-71a0f67d46e9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:50.698739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ac6f7b66-a6d5-4c82-8f63-71a0f67d46e9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041752 Nov 08 17:47:50.699324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 834/1644] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:50.826362 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1ea6e3f4-4532-4cae-89c7-c3a8ff3433d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:50.827268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1ea6e3f4-4532-4cae-89c7-c3a8ff3433d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:50.833695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ea6e3f4-4532-4cae-89c7-c3a8ff3433d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:50.834130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ea6e3f4-4532-4cae-89c7-c3a8ff3433d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:50.834914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ea6e3f4-4532-4cae-89c7-c3a8ff3433d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:50.835340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ea6e3f4-4532-4cae-89c7-c3a8ff3433d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:50.863997 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1ea6e3f4-4532-4cae-89c7-c3a8ff3433d8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042540 Nov 08 17:47:50.864531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 811/1645] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:50.934012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5a9552e6-0fe7-4c29-b93d-cc3c7cc74802 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3b2040>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:50.979201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5a9552e6-0fe7-4c29-b93d-cc3c7cc74802 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048726 Nov 08 17:47:50.979762 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 835/1646] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:50 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:51.710324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d0fce132-9180-4da3-b9fa-6439694ac806 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:51.711241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d0fce132-9180-4da3-b9fa-6439694ac806 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:51.717103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0fce132-9180-4da3-b9fa-6439694ac806 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:51.717543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0fce132-9180-4da3-b9fa-6439694ac806 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:51.718307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0fce132-9180-4da3-b9fa-6439694ac806 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:51.718761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0fce132-9180-4da3-b9fa-6439694ac806 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:51.748206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d0fce132-9180-4da3-b9fa-6439694ac806 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041674 Nov 08 17:47:51.748759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 812/1647] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:51.877116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d955abc6-eff5-4db2-81a0-8fa49d82b8bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:51.878038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d955abc6-eff5-4db2-81a0-8fa49d82b8bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:51.884674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d955abc6-eff5-4db2-81a0-8fa49d82b8bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:51.885121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d955abc6-eff5-4db2-81a0-8fa49d82b8bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:51.885890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d955abc6-eff5-4db2-81a0-8fa49d82b8bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:51.886320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d955abc6-eff5-4db2-81a0-8fa49d82b8bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:51.913982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d955abc6-eff5-4db2-81a0-8fa49d82b8bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041234 Nov 08 17:47:51.914540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 836/1648] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:51.991621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-038a1db5-cc57-41e5-95cc-f036c9762af6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e8160>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:52.036523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-038a1db5-cc57-41e5-95cc-f036c9762af6 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048630 Nov 08 17:47:52.037082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 813/1649] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:51 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:52.759064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-73b3a5d0-28e1-41e3-ab88-95d5b78dfdbc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:52.760643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-73b3a5d0-28e1-41e3-ab88-95d5b78dfdbc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:52.766731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73b3a5d0-28e1-41e3-ab88-95d5b78dfdbc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:52.767177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73b3a5d0-28e1-41e3-ab88-95d5b78dfdbc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:52.767968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73b3a5d0-28e1-41e3-ab88-95d5b78dfdbc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:52.768394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73b3a5d0-28e1-41e3-ab88-95d5b78dfdbc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:52.796385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-73b3a5d0-28e1-41e3-ab88-95d5b78dfdbc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041068 Nov 08 17:47:52.796926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 837/1650] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:52.925031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-515e5b1b-56cd-47d7-8009-fa044a03870f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:52.925960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-515e5b1b-56cd-47d7-8009-fa044a03870f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:52.933489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-515e5b1b-56cd-47d7-8009-fa044a03870f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:52.933940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-515e5b1b-56cd-47d7-8009-fa044a03870f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:52.934726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-515e5b1b-56cd-47d7-8009-fa044a03870f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:52.935163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-515e5b1b-56cd-47d7-8009-fa044a03870f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:52.963046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-515e5b1b-56cd-47d7-8009-fa044a03870f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041800 Nov 08 17:47:52.963684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 814/1651] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:53.048799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-96207839-1dfa-476e-bd25-55a36330924c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec5743a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:53.093517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-96207839-1dfa-476e-bd25-55a36330924c tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048288 Nov 08 17:47:53.094084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 838/1652] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:53 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:53.808171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-be4e677e-fe84-4a83-838b-c4d6ac671a31 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:53.809081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-be4e677e-fe84-4a83-838b-c4d6ac671a31 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:53.815305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be4e677e-fe84-4a83-838b-c4d6ac671a31 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:53.815756 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be4e677e-fe84-4a83-838b-c4d6ac671a31 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:53.816584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be4e677e-fe84-4a83-838b-c4d6ac671a31 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:53.816967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be4e677e-fe84-4a83-838b-c4d6ac671a31 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:53.846353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-be4e677e-fe84-4a83-838b-c4d6ac671a31 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Nov 08 17:47:53.846930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 815/1653] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:53.974501 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1df1a123-634c-4edf-84a3-c3728b265b2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:53.975405 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1df1a123-634c-4edf-84a3-c3728b265b2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:53.982063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1df1a123-634c-4edf-84a3-c3728b265b2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:53.982536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1df1a123-634c-4edf-84a3-c3728b265b2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:53.983338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1df1a123-634c-4edf-84a3-c3728b265b2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:53.983774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1df1a123-634c-4edf-84a3-c3728b265b2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:54.012822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1df1a123-634c-4edf-84a3-c3728b265b2e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042055 Nov 08 17:47:54.013379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 839/1654] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:47:54.106125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d58450e7-5582-459b-81c0-f1edcc9ad471 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1ec4c0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:54.151458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d58450e7-5582-459b-81c0-f1edcc9ad471 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049374 Nov 08 17:47:54.152215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 816/1655] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:54 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:54.857949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-785a4c86-9810-48b1-bc84-2e17b87b5ea6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:54.858880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-785a4c86-9810-48b1-bc84-2e17b87b5ea6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:54.865428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-785a4c86-9810-48b1-bc84-2e17b87b5ea6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:54.865870 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-785a4c86-9810-48b1-bc84-2e17b87b5ea6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:54.866667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-785a4c86-9810-48b1-bc84-2e17b87b5ea6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:54.867105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-785a4c86-9810-48b1-bc84-2e17b87b5ea6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:54.894829 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-785a4c86-9810-48b1-bc84-2e17b87b5ea6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041096 Nov 08 17:47:54.895383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 840/1656] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:55.024124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e152c5d4-76cd-4b6b-8f91-774fd34be8f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:55.025144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e152c5d4-76cd-4b6b-8f91-774fd34be8f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:55.032301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e152c5d4-76cd-4b6b-8f91-774fd34be8f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:55.032740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e152c5d4-76cd-4b6b-8f91-774fd34be8f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:55.033505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e152c5d4-76cd-4b6b-8f91-774fd34be8f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:55.034045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e152c5d4-76cd-4b6b-8f91-774fd34be8f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:55.062519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e152c5d4-76cd-4b6b-8f91-774fd34be8f2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042522 Nov 08 17:47:55.063114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 817/1657] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:55.163341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b1a99c39-37ab-4ab0-9ee2-61ed9eed32d5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2134c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:55.207757 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b1a99c39-37ab-4ab0-9ee2-61ed9eed32d5 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.047976 Nov 08 17:47:55.208456 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 841/1658] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:55 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:55.905926 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8225fdd4-ee28-4616-b28d-2e069c590b63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:55.906844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8225fdd4-ee28-4616-b28d-2e069c590b63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:55.912590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8225fdd4-ee28-4616-b28d-2e069c590b63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:55.913027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8225fdd4-ee28-4616-b28d-2e069c590b63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:55.913783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8225fdd4-ee28-4616-b28d-2e069c590b63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:55.914216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8225fdd4-ee28-4616-b28d-2e069c590b63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:55.941188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8225fdd4-ee28-4616-b28d-2e069c590b63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038982 Nov 08 17:47:55.941723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 818/1659] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:56.074940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-95886d32-7dc9-4b69-93bb-90935de52110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:56.075817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-95886d32-7dc9-4b69-93bb-90935de52110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:56.082278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95886d32-7dc9-4b69-93bb-90935de52110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:56.082743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95886d32-7dc9-4b69-93bb-90935de52110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:56.083503 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95886d32-7dc9-4b69-93bb-90935de52110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:56.083932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95886d32-7dc9-4b69-93bb-90935de52110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:56.111143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-95886d32-7dc9-4b69-93bb-90935de52110 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041204 Nov 08 17:47:56.111959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 842/1660] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:56.219875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-003a111e-92ec-4d5a-8ac8-0c6bd3dbe510 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e84c0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:56.268453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-003a111e-92ec-4d5a-8ac8-0c6bd3dbe510 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.052153 Nov 08 17:47:56.269145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 819/1661] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:56 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:56.952578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bfb7b5d8-d920-43b1-baad-b388bd533252 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:56.953520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bfb7b5d8-d920-43b1-baad-b388bd533252 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:56.959384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfb7b5d8-d920-43b1-baad-b388bd533252 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:56.959833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfb7b5d8-d920-43b1-baad-b388bd533252 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:56.960612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfb7b5d8-d920-43b1-baad-b388bd533252 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:56.961046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfb7b5d8-d920-43b1-baad-b388bd533252 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:56.990244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bfb7b5d8-d920-43b1-baad-b388bd533252 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041449 Nov 08 17:47:56.990839 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 843/1662] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:57.123010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bcc60d14-2d48-45a6-b8e3-6afae09e54c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:57.123943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bcc60d14-2d48-45a6-b8e3-6afae09e54c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:57.130377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bcc60d14-2d48-45a6-b8e3-6afae09e54c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:57.130846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bcc60d14-2d48-45a6-b8e3-6afae09e54c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:57.131617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bcc60d14-2d48-45a6-b8e3-6afae09e54c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:57.132042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bcc60d14-2d48-45a6-b8e3-6afae09e54c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:57.160498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bcc60d14-2d48-45a6-b8e3-6afae09e54c4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041323 Nov 08 17:47:57.161038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 820/1663] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:57.280633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4a9ed6b1-9d73-4b9f-82b9-44abef6c4eaa tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec5a2c10>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:57.325906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4a9ed6b1-9d73-4b9f-82b9-44abef6c4eaa tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048862 Nov 08 17:47:57.326493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 844/1664] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:57 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:47:58.003863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7c15df5d-0872-4fea-9911-37a6c31361c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:58.005098 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7c15df5d-0872-4fea-9911-37a6c31361c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:58.013991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7c15df5d-0872-4fea-9911-37a6c31361c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:58.014518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7c15df5d-0872-4fea-9911-37a6c31361c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:58.015687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7c15df5d-0872-4fea-9911-37a6c31361c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:58.016442 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7c15df5d-0872-4fea-9911-37a6c31361c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:58.047984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7c15df5d-0872-4fea-9911-37a6c31361c4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050064 Nov 08 17:47:58.048534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 821/1665] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:58.172125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-00be9431-bc30-4709-a933-dca39c9b5f45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:58.172984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-00be9431-bc30-4709-a933-dca39c9b5f45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:58.179583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-00be9431-bc30-4709-a933-dca39c9b5f45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:58.180026 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-00be9431-bc30-4709-a933-dca39c9b5f45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:58.180797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-00be9431-bc30-4709-a933-dca39c9b5f45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:58.181227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-00be9431-bc30-4709-a933-dca39c9b5f45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:58.210506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-00be9431-bc30-4709-a933-dca39c9b5f45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042193 Nov 08 17:47:58.211042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 845/1666] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:58.338006 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d99c427e-be5c-4b6c-b715-f5932df8a178 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2a1c10>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:58.383344 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d99c427e-be5c-4b6c-b715-f5932df8a178 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048979 Nov 08 17:47:58.383909 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 822/1667] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:58 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:59.059220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dc5fb2fb-ebb6-42bc-aa5c-4a6733cd40f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:59.060149 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dc5fb2fb-ebb6-42bc-aa5c-4a6733cd40f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:59.066340 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc5fb2fb-ebb6-42bc-aa5c-4a6733cd40f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:59.066823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc5fb2fb-ebb6-42bc-aa5c-4a6733cd40f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:59.067584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc5fb2fb-ebb6-42bc-aa5c-4a6733cd40f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:59.068013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc5fb2fb-ebb6-42bc-aa5c-4a6733cd40f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:59.095731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dc5fb2fb-ebb6-42bc-aa5c-4a6733cd40f0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040266 Nov 08 17:47:59.096267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 846/1668] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:47:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:47:59.223308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5aed4f93-84f7-4d85-8ccc-fd3155ea9023 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:59.224224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5aed4f93-84f7-4d85-8ccc-fd3155ea9023 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:47:59.231374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5aed4f93-84f7-4d85-8ccc-fd3155ea9023 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:59.237738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5aed4f93-84f7-4d85-8ccc-fd3155ea9023 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:59.237738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5aed4f93-84f7-4d85-8ccc-fd3155ea9023 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:47:59.237738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5aed4f93-84f7-4d85-8ccc-fd3155ea9023 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:47:59.261059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5aed4f93-84f7-4d85-8ccc-fd3155ea9023 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041605 Nov 08 17:47:59.261388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 823/1669] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:47:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:47:59.395849 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-321944cf-9fbf-4f97-a89a-cffc47e27a37 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3733a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:47:59.440657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-321944cf-9fbf-4f97-a89a-cffc47e27a37 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048315 Nov 08 17:47:59.441219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 847/1670] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:47:59 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:00.107397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5c5d70fe-5b3d-49a9-85b1-50a958e57c57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:00.108220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5c5d70fe-5b3d-49a9-85b1-50a958e57c57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:00.114302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c5d70fe-5b3d-49a9-85b1-50a958e57c57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:00.114771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c5d70fe-5b3d-49a9-85b1-50a958e57c57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:00.115533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c5d70fe-5b3d-49a9-85b1-50a958e57c57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:00.115963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c5d70fe-5b3d-49a9-85b1-50a958e57c57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:00.145393 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5c5d70fe-5b3d-49a9-85b1-50a958e57c57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042190 Nov 08 17:48:00.145941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 824/1671] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:00.272709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8681558a-b3af-461e-acf7-a0d4e3a207ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:00.273593 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8681558a-b3af-461e-acf7-a0d4e3a207ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:00.280178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8681558a-b3af-461e-acf7-a0d4e3a207ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:00.280619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8681558a-b3af-461e-acf7-a0d4e3a207ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:00.281388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8681558a-b3af-461e-acf7-a0d4e3a207ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:00.281818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8681558a-b3af-461e-acf7-a0d4e3a207ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:00.311135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8681558a-b3af-461e-acf7-a0d4e3a207ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042706 Nov 08 17:48:00.311688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 848/1672] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:00.452943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-00a1aa1e-f39e-45ff-b1f0-23b0b4553f62 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1ec040>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:00.499455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-00a1aa1e-f39e-45ff-b1f0-23b0b4553f62 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050130 Nov 08 17:48:00.500015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 825/1673] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:00 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:48:01.157691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3c29449d-b259-4999-93ee-7822d0167377 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:01.158630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3c29449d-b259-4999-93ee-7822d0167377 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:01.164464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c29449d-b259-4999-93ee-7822d0167377 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:01.164912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c29449d-b259-4999-93ee-7822d0167377 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:01.165683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c29449d-b259-4999-93ee-7822d0167377 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:01.166113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3c29449d-b259-4999-93ee-7822d0167377 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:01.194531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3c29449d-b259-4999-93ee-7822d0167377 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040568 Nov 08 17:48:01.195091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 849/1674] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:01.322683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e3a2ae5c-24d8-44b8-a4ff-cebc4fea21de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:01.324246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e3a2ae5c-24d8-44b8-a4ff-cebc4fea21de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:01.330659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3a2ae5c-24d8-44b8-a4ff-cebc4fea21de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:01.331108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3a2ae5c-24d8-44b8-a4ff-cebc4fea21de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:01.332672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3a2ae5c-24d8-44b8-a4ff-cebc4fea21de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:01.332672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3a2ae5c-24d8-44b8-a4ff-cebc4fea21de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:01.359775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e3a2ae5c-24d8-44b8-a4ff-cebc4fea21de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041027 Nov 08 17:48:01.361771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 826/1675] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:01.510768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f9884e8d-8aa1-48e9-9074-0f55a5fb5a5b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec373dc0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:01.556352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f9884e8d-8aa1-48e9-9074-0f55a5fb5a5b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049116 Nov 08 17:48:01.556928 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 850/1676] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:01 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:02.206317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-95e83e77-d1da-4fcc-9ead-f8756903fe9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:02.207246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-95e83e77-d1da-4fcc-9ead-f8756903fe9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:02.213948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-95e83e77-d1da-4fcc-9ead-f8756903fe9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:02.214691 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-95e83e77-d1da-4fcc-9ead-f8756903fe9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:02.215476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-95e83e77-d1da-4fcc-9ead-f8756903fe9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:02.215907 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-95e83e77-d1da-4fcc-9ead-f8756903fe9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:02.244560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-95e83e77-d1da-4fcc-9ead-f8756903fe9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 Nov 08 17:48:02.245048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 827/1677] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:02.371218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2e6be8c0-1296-4ee6-ba35-fbc298cfaa74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:02.372122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2e6be8c0-1296-4ee6-ba35-fbc298cfaa74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:02.378657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e6be8c0-1296-4ee6-ba35-fbc298cfaa74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:02.379103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e6be8c0-1296-4ee6-ba35-fbc298cfaa74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:02.379862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e6be8c0-1296-4ee6-ba35-fbc298cfaa74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:02.380289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e6be8c0-1296-4ee6-ba35-fbc298cfaa74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:02.409227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2e6be8c0-1296-4ee6-ba35-fbc298cfaa74 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041849 Nov 08 17:48:02.409769 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 851/1678] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:02.568491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-555dcfa4-7241-4bdb-98ab-f071ca7eddda tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec251160>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:02.614182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-555dcfa4-7241-4bdb-98ab-f071ca7eddda tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049217 Nov 08 17:48:02.614792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 828/1679] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:02 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:03.255988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0ff8e13d-2b00-40fc-8cb0-a21636304be0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:03.256819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0ff8e13d-2b00-40fc-8cb0-a21636304be0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:03.263229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ff8e13d-2b00-40fc-8cb0-a21636304be0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:03.263670 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ff8e13d-2b00-40fc-8cb0-a21636304be0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:03.264433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ff8e13d-2b00-40fc-8cb0-a21636304be0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:03.264863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0ff8e13d-2b00-40fc-8cb0-a21636304be0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:03.292838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0ff8e13d-2b00-40fc-8cb0-a21636304be0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040687 Nov 08 17:48:03.293378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 852/1680] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:03.421554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-adf180b6-d61e-4884-927d-8aff3909b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:03.422502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-adf180b6-d61e-4884-927d-8aff3909b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:03.429007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-adf180b6-d61e-4884-927d-8aff3909b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:03.429452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-adf180b6-d61e-4884-927d-8aff3909b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:03.430218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-adf180b6-d61e-4884-927d-8aff3909b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:03.430684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-adf180b6-d61e-4884-927d-8aff3909b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:03.463961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-adf180b6-d61e-4884-927d-8aff3909b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047051 Nov 08 17:48:03.464520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 829/1681] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:03.625462 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5663cc03-53a8-4395-9cf8-cce996d9de08 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec23b8b0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:03.670592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5663cc03-53a8-4395-9cf8-cce996d9de08 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.048635 Nov 08 17:48:03.671152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 853/1682] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:03 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:04.303210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ba265fe3-f382-48af-b665-05117d569ef5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:04.304023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ba265fe3-f382-48af-b665-05117d569ef5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:04.311457 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba265fe3-f382-48af-b665-05117d569ef5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:04.311896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba265fe3-f382-48af-b665-05117d569ef5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:04.312658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba265fe3-f382-48af-b665-05117d569ef5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:04.313105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba265fe3-f382-48af-b665-05117d569ef5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:04.344037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ba265fe3-f382-48af-b665-05117d569ef5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Nov 08 17:48:04.344585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 830/1683] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:04.476437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-693b6950-6509-4320-8869-c485ee9a29f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:04.477348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-693b6950-6509-4320-8869-c485ee9a29f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:04.485064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-693b6950-6509-4320-8869-c485ee9a29f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:04.485508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-693b6950-6509-4320-8869-c485ee9a29f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:04.486284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-693b6950-6509-4320-8869-c485ee9a29f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:04.487009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-693b6950-6509-4320-8869-c485ee9a29f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:04.518763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-693b6950-6509-4320-8869-c485ee9a29f1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046646 Nov 08 17:48:04.519325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 854/1684] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:04.684191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f0049e36-ed47-4496-849d-88102504f15b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c0d30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:04.730690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f0049e36-ed47-4496-849d-88102504f15b tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.051262 Nov 08 17:48:04.731254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 831/1685] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:04 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:05.106362 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1dabca1f-b401-46db-9328-b662efaa3d22 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] Calling method '.version_select at 0x7f06ec3783a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:05.111735 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1dabca1f-b401-46db-9328-b662efaa3d22 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] [83a2ba09-7aa0-4dcd-99a8-67aaaadf900f] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 08 17:48:05.356434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-eafc89f0-34cf-4b3d-b9c5-c60b29c41cae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:05.357351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-eafc89f0-34cf-4b3d-b9c5-c60b29c41cae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:05.364214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eafc89f0-34cf-4b3d-b9c5-c60b29c41cae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:05.364601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eafc89f0-34cf-4b3d-b9c5-c60b29c41cae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:05.365373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eafc89f0-34cf-4b3d-b9c5-c60b29c41cae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:05.365802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eafc89f0-34cf-4b3d-b9c5-c60b29c41cae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:05.394031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-eafc89f0-34cf-4b3d-b9c5-c60b29c41cae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042144 Nov 08 17:48:05.394604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 832/1686] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:48:05.531101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-981ccf9d-2f15-4c60-a39f-bf74ab82f428 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:05.531996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-981ccf9d-2f15-4c60-a39f-bf74ab82f428 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:05.537780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-981ccf9d-2f15-4c60-a39f-bf74ab82f428 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:05.538226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-981ccf9d-2f15-4c60-a39f-bf74ab82f428 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:05.539020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-981ccf9d-2f15-4c60-a39f-bf74ab82f428 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:05.539452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-981ccf9d-2f15-4c60-a39f-bf74ab82f428 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:05.566947 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-981ccf9d-2f15-4c60-a39f-bf74ab82f428 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039486 Nov 08 17:48:05.567481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 833/1687] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:48:05.743626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6d7c6c22-b124-4754-9ed3-2be2e1fc7642 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec1e2a60>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:05.790009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6d7c6c22-b124-4754-9ed3-2be2e1fc7642 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050039 Nov 08 17:48:05.790597 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 834/1688] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:05 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:48:06.126376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [None req-1dabca1f-b401-46db-9328-b662efaa3d22 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] [83a2ba09-7aa0-4dcd-99a8-67aaaadf900f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50478. Nov 08 17:48:06.256685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1dabca1f-b401-46db-9328-b662efaa3d22 tempest-TestShelveInstance-801873482 tempest-TestShelveInstance-801873482-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-550971990" status: 202 len: 0 microversion: 2.1 time: 1.154088 Nov 08 17:48:06.257274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 855/1689] 10.222.0.18 () {58 vars in 1250 bytes} [Mon Nov 8 17:48:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-550971990 => generated 0 bytes in 1155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:48:06.405192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-69bc205e-3a45-45f3-aced-585f54e86360 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:06.406046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-69bc205e-3a45-45f3-aced-585f54e86360 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:06.412698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69bc205e-3a45-45f3-aced-585f54e86360 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:06.413151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69bc205e-3a45-45f3-aced-585f54e86360 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:06.413930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69bc205e-3a45-45f3-aced-585f54e86360 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:06.414364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69bc205e-3a45-45f3-aced-585f54e86360 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:06.444950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-69bc205e-3a45-45f3-aced-585f54e86360 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043560 Nov 08 17:48:06.445649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 835/1690] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:06.579185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7afdfcd5-afd2-474e-873d-cedc37b10f7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:06.580119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7afdfcd5-afd2-474e-873d-cedc37b10f7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:06.586508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7afdfcd5-afd2-474e-873d-cedc37b10f7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:06.586965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7afdfcd5-afd2-474e-873d-cedc37b10f7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:06.587733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7afdfcd5-afd2-474e-873d-cedc37b10f7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:06.588697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7afdfcd5-afd2-474e-873d-cedc37b10f7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:06.618117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7afdfcd5-afd2-474e-873d-cedc37b10f7b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043201 Nov 08 17:48:06.618716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 856/1691] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:06.802357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4a7946a2-30ba-4bb3-b86d-54cdd9619f58 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec2c0d30>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:06.848538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4a7946a2-30ba-4bb3-b86d-54cdd9619f58 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049860 Nov 08 17:48:06.849112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 836/1692] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:06 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:07.456557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-02336ebb-47c1-435a-9655-bb7444096ab7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:07.457475 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-02336ebb-47c1-435a-9655-bb7444096ab7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:07.463822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02336ebb-47c1-435a-9655-bb7444096ab7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:07.464406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02336ebb-47c1-435a-9655-bb7444096ab7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:07.465190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02336ebb-47c1-435a-9655-bb7444096ab7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:07.465642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02336ebb-47c1-435a-9655-bb7444096ab7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:07.496793 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-02336ebb-47c1-435a-9655-bb7444096ab7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043949 Nov 08 17:48:07.497358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 857/1693] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:07.629134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-38fd078c-0dad-4c7c-b591-b822214e6514 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:07.630035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-38fd078c-0dad-4c7c-b591-b822214e6514 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:07.636907 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38fd078c-0dad-4c7c-b591-b822214e6514 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:07.637352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38fd078c-0dad-4c7c-b591-b822214e6514 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:07.638123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38fd078c-0dad-4c7c-b591-b822214e6514 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:07.638596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38fd078c-0dad-4c7c-b591-b822214e6514 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:07.667494 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-38fd078c-0dad-4c7c-b591-b822214e6514 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041765 Nov 08 17:48:07.668076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 837/1694] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:07.860765 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-09586b03-1396-4f1f-83c6-276fb9ffb380 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ed0e9dc0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:07.907589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-09586b03-1396-4f1f-83c6-276fb9ffb380 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.050337 Nov 08 17:48:07.908162 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 858/1695] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:07 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:48:08.508088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-13429c57-48c2-41dc-8d77-1e351f91f2bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:08.508944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-13429c57-48c2-41dc-8d77-1e351f91f2bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:08.515753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13429c57-48c2-41dc-8d77-1e351f91f2bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:08.516805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13429c57-48c2-41dc-8d77-1e351f91f2bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:08.517431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13429c57-48c2-41dc-8d77-1e351f91f2bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:08.517626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13429c57-48c2-41dc-8d77-1e351f91f2bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:08.548502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-13429c57-48c2-41dc-8d77-1e351f91f2bf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Nov 08 17:48:08.549293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 838/1696] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:08.679110 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-489504de-d3ff-4200-a9f6-21bd5cd86718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:08.680238 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-489504de-d3ff-4200-a9f6-21bd5cd86718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:08.686984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-489504de-d3ff-4200-a9f6-21bd5cd86718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:08.687547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-489504de-d3ff-4200-a9f6-21bd5cd86718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:08.688489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-489504de-d3ff-4200-a9f6-21bd5cd86718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:08.689012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-489504de-d3ff-4200-a9f6-21bd5cd86718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:08.720207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-489504de-d3ff-4200-a9f6-21bd5cd86718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044822 Nov 08 17:48:08.721056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 859/1697] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:08.920422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a08928d7-31dd-4d86-860f-53aa918d9e36 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec251550>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:08.969438 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a08928d7-31dd-4d86-860f-53aa918d9e36 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053294 Nov 08 17:48:08.970239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 839/1698] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:08 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:09.560508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b83e0ca4-01ee-45b7-b6ac-751654b7a1da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:09.565182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b83e0ca4-01ee-45b7-b6ac-751654b7a1da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:09.567486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b83e0ca4-01ee-45b7-b6ac-751654b7a1da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:09.567919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b83e0ca4-01ee-45b7-b6ac-751654b7a1da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:09.568734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b83e0ca4-01ee-45b7-b6ac-751654b7a1da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:09.569166 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b83e0ca4-01ee-45b7-b6ac-751654b7a1da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:09.602289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b83e0ca4-01ee-45b7-b6ac-751654b7a1da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Nov 08 17:48:09.603473 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 860/1699] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:09.732119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8fc04127-9ba7-42c8-bfaf-50888490255d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:09.733051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8fc04127-9ba7-42c8-bfaf-50888490255d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:09.745342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fc04127-9ba7-42c8-bfaf-50888490255d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:09.746976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fc04127-9ba7-42c8-bfaf-50888490255d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:09.747950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fc04127-9ba7-42c8-bfaf-50888490255d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:09.748548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fc04127-9ba7-42c8-bfaf-50888490255d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:09.781475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8fc04127-9ba7-42c8-bfaf-50888490255d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053176 Nov 08 17:48:09.782213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 840/1700] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:09.982198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-be823fb0-7998-404a-a0ff-0a4642e16e87 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3b28b0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:10.059408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-be823fb0-7998-404a-a0ff-0a4642e16e87 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.081891 Nov 08 17:48:10.060161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 861/1701] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:09 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:10.614571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-13e807a9-58d4-4fe8-86f5-7d1047d2535e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:10.615164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-13e807a9-58d4-4fe8-86f5-7d1047d2535e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:10.622249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13e807a9-58d4-4fe8-86f5-7d1047d2535e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:10.622727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13e807a9-58d4-4fe8-86f5-7d1047d2535e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:10.623499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13e807a9-58d4-4fe8-86f5-7d1047d2535e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:10.623927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-13e807a9-58d4-4fe8-86f5-7d1047d2535e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:10.655651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-13e807a9-58d4-4fe8-86f5-7d1047d2535e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Nov 08 17:48:10.656209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 841/1702] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:10.793603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c2cfb37a-8082-49c9-abbb-68c326152004 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:10.794551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c2cfb37a-8082-49c9-abbb-68c326152004 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:10.801439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2cfb37a-8082-49c9-abbb-68c326152004 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:10.801840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2cfb37a-8082-49c9-abbb-68c326152004 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:10.802974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2cfb37a-8082-49c9-abbb-68c326152004 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:10.803141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c2cfb37a-8082-49c9-abbb-68c326152004 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:10.833975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c2cfb37a-8082-49c9-abbb-68c326152004 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044671 Nov 08 17:48:10.834572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 862/1703] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:11.055177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-41e63887-f18d-434b-ba85-509cb0bad5fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:11.055771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-41e63887-f18d-434b-ba85-509cb0bad5fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:11.062619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41e63887-f18d-434b-ba85-509cb0bad5fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:11.063146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41e63887-f18d-434b-ba85-509cb0bad5fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:11.063995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41e63887-f18d-434b-ba85-509cb0bad5fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:11.064497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41e63887-f18d-434b-ba85-509cb0bad5fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:11.071649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1c90eea0-070d-4369-a246-90c57d7cae81 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3c34c0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:11.117622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1c90eea0-070d-4369-a246-90c57d7cae81 tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.049493 Nov 08 17:48:11.122516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 863/1704] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:11 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:48:11.165973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-41e63887-f18d-434b-ba85-509cb0bad5fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lazy-loading 'services' on Instance uuid 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:48:11.377871 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-41e63887-f18d-434b-ba85-509cb0bad5fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe/os-volume_attachments/02294efe-ef2e-4847-aa14-107ac0db8bd3" status: 202 len: 0 microversion: 2.1 time: 0.326191 Nov 08 17:48:11.378585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 842/1705] 10.222.0.18 () {58 vars in 1415 bytes} [Mon Nov 8 17:48:11 2021] DELETE /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe/os-volume_attachments/02294efe-ef2e-4847-aa14-107ac0db8bd3 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:48:11.667551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5c8d375b-29a3-4bcb-9fdf-bcfc6a0efb6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:11.668470 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5c8d375b-29a3-4bcb-9fdf-bcfc6a0efb6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:11.674255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c8d375b-29a3-4bcb-9fdf-bcfc6a0efb6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:11.674735 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c8d375b-29a3-4bcb-9fdf-bcfc6a0efb6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:11.675517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c8d375b-29a3-4bcb-9fdf-bcfc6a0efb6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:11.675952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5c8d375b-29a3-4bcb-9fdf-bcfc6a0efb6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:11.704943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5c8d375b-29a3-4bcb-9fdf-bcfc6a0efb6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041695 Nov 08 17:48:11.705504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 864/1706] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:11.847487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b1bcee0c-a092-4d46-bf21-760525fff6e0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:11.848446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b1bcee0c-a092-4d46-bf21-760525fff6e0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:11.855117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1bcee0c-a092-4d46-bf21-760525fff6e0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:11.855560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1bcee0c-a092-4d46-bf21-760525fff6e0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:11.856327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1bcee0c-a092-4d46-bf21-760525fff6e0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:11.856942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1bcee0c-a092-4d46-bf21-760525fff6e0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:11.886942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b1bcee0c-a092-4d46-bf21-760525fff6e0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044766 Nov 08 17:48:11.887539 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 843/1707] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:12.130663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d559a5ad-b87b-4f2d-b0ba-05612574a52a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] Calling method '.version_select at 0x7f06ec3783a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:12.180716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d559a5ad-b87b-4f2d-b0ba-05612574a52a tempest-VolumesGetTestJSON-728020611 tempest-VolumesGetTestJSON-728020611-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043" status: 200 len: 353 microversion: 2.1 time: 0.053896 Nov 08 17:48:12.181293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 865/1708] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 17:48:12 2021] GET /compute/v2.1/os-volumes/c086c602-3e9b-439a-be7a-caad37e86043 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:12.717850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-08b353db-b412-4c02-a5e1-47eece6e2732 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:12.718961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-08b353db-b412-4c02-a5e1-47eece6e2732 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:12.724777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08b353db-b412-4c02-a5e1-47eece6e2732 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:12.725491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08b353db-b412-4c02-a5e1-47eece6e2732 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:12.726408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08b353db-b412-4c02-a5e1-47eece6e2732 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:12.727076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08b353db-b412-4c02-a5e1-47eece6e2732 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:12.760218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-08b353db-b412-4c02-a5e1-47eece6e2732 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047598 Nov 08 17:48:12.764006 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 844/1709] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:12.899150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e3df12c9-3793-4e34-9110-cbc442a06392 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:12.900074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e3df12c9-3793-4e34-9110-cbc442a06392 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:12.907606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e3df12c9-3793-4e34-9110-cbc442a06392 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:12.908130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e3df12c9-3793-4e34-9110-cbc442a06392 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:12.908909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e3df12c9-3793-4e34-9110-cbc442a06392 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:12.909349 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e3df12c9-3793-4e34-9110-cbc442a06392 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:12.948168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e3df12c9-3793-4e34-9110-cbc442a06392 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049680 Nov 08 17:48:12.948168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 866/1710] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:13.781781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2976a881-d973-41ba-bf3a-6827c1460f68 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:13.783897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2976a881-d973-41ba-bf3a-6827c1460f68 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:13.797759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2976a881-d973-41ba-bf3a-6827c1460f68 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:13.798517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2976a881-d973-41ba-bf3a-6827c1460f68 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:13.799540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2976a881-d973-41ba-bf3a-6827c1460f68 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:13.800137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2976a881-d973-41ba-bf3a-6827c1460f68 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:13.842877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2976a881-d973-41ba-bf3a-6827c1460f68 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075440 Nov 08 17:48:13.843460 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 845/1711] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:13.957275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7ea9ed95-5b2a-4174-94fa-8c50b0399d0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:13.958355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7ea9ed95-5b2a-4174-94fa-8c50b0399d0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:13.965356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ea9ed95-5b2a-4174-94fa-8c50b0399d0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:13.965804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ea9ed95-5b2a-4174-94fa-8c50b0399d0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:13.966628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ea9ed95-5b2a-4174-94fa-8c50b0399d0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:13.967062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ea9ed95-5b2a-4174-94fa-8c50b0399d0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:13.998447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7ea9ed95-5b2a-4174-94fa-8c50b0399d0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044955 Nov 08 17:48:13.999072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 867/1712] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:14.854039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c59de591-f719-4a36-abba-e7ef20e34f4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:14.855051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c59de591-f719-4a36-abba-e7ef20e34f4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:14.861652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c59de591-f719-4a36-abba-e7ef20e34f4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:14.862101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c59de591-f719-4a36-abba-e7ef20e34f4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:14.862900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c59de591-f719-4a36-abba-e7ef20e34f4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:14.863333 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c59de591-f719-4a36-abba-e7ef20e34f4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:14.893392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c59de591-f719-4a36-abba-e7ef20e34f4c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043114 Nov 08 17:48:14.894214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 846/1713] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:15.009302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-27528f9d-f685-4f0e-a14e-56a6f33e866e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:15.010268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-27528f9d-f685-4f0e-a14e-56a6f33e866e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:15.017719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27528f9d-f685-4f0e-a14e-56a6f33e866e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:15.018177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27528f9d-f685-4f0e-a14e-56a6f33e866e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:15.018994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27528f9d-f685-4f0e-a14e-56a6f33e866e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:15.019431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-27528f9d-f685-4f0e-a14e-56a6f33e866e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:15.050835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-27528f9d-f685-4f0e-a14e-56a6f33e866e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045379 Nov 08 17:48:15.051592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 868/1714] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:15.905905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b1fa73cc-fc57-4720-8ede-c1aad458f40d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:15.906802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b1fa73cc-fc57-4720-8ede-c1aad458f40d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:15.913037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1fa73cc-fc57-4720-8ede-c1aad458f40d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:15.913507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1fa73cc-fc57-4720-8ede-c1aad458f40d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:15.914314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1fa73cc-fc57-4720-8ede-c1aad458f40d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:15.914775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1fa73cc-fc57-4720-8ede-c1aad458f40d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:15.952667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b1fa73cc-fc57-4720-8ede-c1aad458f40d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042883 Nov 08 17:48:15.952667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 847/1715] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:16.063204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-21a8e78e-d69e-4537-b32f-9e52bb24fea2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:16.064408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-21a8e78e-d69e-4537-b32f-9e52bb24fea2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:16.076964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-21a8e78e-d69e-4537-b32f-9e52bb24fea2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:16.078005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-21a8e78e-d69e-4537-b32f-9e52bb24fea2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:16.078939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-21a8e78e-d69e-4537-b32f-9e52bb24fea2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:16.079370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-21a8e78e-d69e-4537-b32f-9e52bb24fea2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:16.121086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-21a8e78e-d69e-4537-b32f-9e52bb24fea2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062014 Nov 08 17:48:16.121744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 869/1716] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:16.955448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1f7c4820-0cf9-4952-a4af-0b6115fb4428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:16.956369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1f7c4820-0cf9-4952-a4af-0b6115fb4428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:16.962517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1f7c4820-0cf9-4952-a4af-0b6115fb4428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:16.962963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1f7c4820-0cf9-4952-a4af-0b6115fb4428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:16.963726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1f7c4820-0cf9-4952-a4af-0b6115fb4428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:16.964927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1f7c4820-0cf9-4952-a4af-0b6115fb4428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:16.993236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1f7c4820-0cf9-4952-a4af-0b6115fb4428 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041552 Nov 08 17:48:16.993789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 848/1717] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:17.132836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-177ed92c-a040-4d88-9cb5-e182977a36d1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:17.133737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-177ed92c-a040-4d88-9cb5-e182977a36d1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:17.140436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-177ed92c-a040-4d88-9cb5-e182977a36d1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:17.140883 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-177ed92c-a040-4d88-9cb5-e182977a36d1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:17.141680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-177ed92c-a040-4d88-9cb5-e182977a36d1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:17.142111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-177ed92c-a040-4d88-9cb5-e182977a36d1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:17.172094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-177ed92c-a040-4d88-9cb5-e182977a36d1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042917 Nov 08 17:48:17.176949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 870/1718] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:18.005046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5146689e-89b0-4c10-afce-fb10f5e2340c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:18.005932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5146689e-89b0-4c10-afce-fb10f5e2340c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:18.012370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5146689e-89b0-4c10-afce-fb10f5e2340c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:18.012808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5146689e-89b0-4c10-afce-fb10f5e2340c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:18.013570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5146689e-89b0-4c10-afce-fb10f5e2340c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:18.013997 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5146689e-89b0-4c10-afce-fb10f5e2340c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:18.043598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5146689e-89b0-4c10-afce-fb10f5e2340c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042286 Nov 08 17:48:18.044152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 849/1719] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:18.184404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-73f63757-ddd8-489d-88a4-154443c2613d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:18.185304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-73f63757-ddd8-489d-88a4-154443c2613d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:18.191477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73f63757-ddd8-489d-88a4-154443c2613d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:18.191919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73f63757-ddd8-489d-88a4-154443c2613d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:18.192730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73f63757-ddd8-489d-88a4-154443c2613d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:18.193165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73f63757-ddd8-489d-88a4-154443c2613d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:18.223905 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-73f63757-ddd8-489d-88a4-154443c2613d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043237 Nov 08 17:48:18.224493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 871/1720] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:19.054448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c0db95fc-210f-4f72-b412-730668bcd0d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:19.055375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c0db95fc-210f-4f72-b412-730668bcd0d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:19.061594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0db95fc-210f-4f72-b412-730668bcd0d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:19.062036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0db95fc-210f-4f72-b412-730668bcd0d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:19.062826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0db95fc-210f-4f72-b412-730668bcd0d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:19.063255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c0db95fc-210f-4f72-b412-730668bcd0d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:19.091853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c0db95fc-210f-4f72-b412-730668bcd0d9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041154 Nov 08 17:48:19.092392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 850/1721] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:19.235477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-53e6c76a-d8a4-4211-bf9f-d2f851757de8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:19.243347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-53e6c76a-d8a4-4211-bf9f-d2f851757de8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:19.243347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-53e6c76a-d8a4-4211-bf9f-d2f851757de8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:19.243347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-53e6c76a-d8a4-4211-bf9f-d2f851757de8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:19.244135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-53e6c76a-d8a4-4211-bf9f-d2f851757de8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:19.244569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-53e6c76a-d8a4-4211-bf9f-d2f851757de8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:19.274973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-53e6c76a-d8a4-4211-bf9f-d2f851757de8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043320 Nov 08 17:48:19.277806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 872/1722] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:20.103180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6e014098-6f7d-4f61-9224-b381ec53154a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:20.104081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6e014098-6f7d-4f61-9224-b381ec53154a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:20.110971 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e014098-6f7d-4f61-9224-b381ec53154a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:20.111680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e014098-6f7d-4f61-9224-b381ec53154a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:20.112449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e014098-6f7d-4f61-9224-b381ec53154a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:20.112879 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e014098-6f7d-4f61-9224-b381ec53154a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:20.140630 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6e014098-6f7d-4f61-9224-b381ec53154a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041186 Nov 08 17:48:20.141170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 851/1723] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:48:20.287304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-71ebd937-dbc4-4131-9b13-2085323e703e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:20.288244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-71ebd937-dbc4-4131-9b13-2085323e703e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:20.295743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71ebd937-dbc4-4131-9b13-2085323e703e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:20.296195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71ebd937-dbc4-4131-9b13-2085323e703e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:20.296975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71ebd937-dbc4-4131-9b13-2085323e703e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:20.297526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71ebd937-dbc4-4131-9b13-2085323e703e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:20.327218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-71ebd937-dbc4-4131-9b13-2085323e703e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043694 Nov 08 17:48:20.327779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 873/1724] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:21.152085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b40e85b9-8d24-4f07-8289-8b1cf6f50451 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:21.152983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b40e85b9-8d24-4f07-8289-8b1cf6f50451 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:21.159170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b40e85b9-8d24-4f07-8289-8b1cf6f50451 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:21.159616 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b40e85b9-8d24-4f07-8289-8b1cf6f50451 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:21.160388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b40e85b9-8d24-4f07-8289-8b1cf6f50451 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:21.160819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b40e85b9-8d24-4f07-8289-8b1cf6f50451 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:21.190282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b40e85b9-8d24-4f07-8289-8b1cf6f50451 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042174 Nov 08 17:48:21.190852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 852/1725] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:21.338346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3799fb15-9970-4d67-a291-7099a87f1c34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:21.339383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3799fb15-9970-4d67-a291-7099a87f1c34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:21.346720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3799fb15-9970-4d67-a291-7099a87f1c34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:21.347016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3799fb15-9970-4d67-a291-7099a87f1c34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:21.347848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3799fb15-9970-4d67-a291-7099a87f1c34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:21.348282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3799fb15-9970-4d67-a291-7099a87f1c34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:21.379061 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3799fb15-9970-4d67-a291-7099a87f1c34 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044400 Nov 08 17:48:21.379529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 874/1726] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:22.201878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1d822dec-a29e-4be3-bea4-a70ca11aa90f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:22.202801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1d822dec-a29e-4be3-bea4-a70ca11aa90f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:22.208936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1d822dec-a29e-4be3-bea4-a70ca11aa90f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:22.209377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1d822dec-a29e-4be3-bea4-a70ca11aa90f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:22.210135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1d822dec-a29e-4be3-bea4-a70ca11aa90f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:22.210593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1d822dec-a29e-4be3-bea4-a70ca11aa90f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:22.239141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1d822dec-a29e-4be3-bea4-a70ca11aa90f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Nov 08 17:48:22.239694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 853/1727] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:22.391278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b1bcc287-2eb6-4396-a584-4f9b33060978 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:22.392321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b1bcc287-2eb6-4396-a584-4f9b33060978 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:22.398580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1bcc287-2eb6-4396-a584-4f9b33060978 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:22.399036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1bcc287-2eb6-4396-a584-4f9b33060978 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:22.399814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1bcc287-2eb6-4396-a584-4f9b33060978 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:22.400246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b1bcc287-2eb6-4396-a584-4f9b33060978 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:22.428594 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b1bcc287-2eb6-4396-a584-4f9b33060978 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041909 Nov 08 17:48:22.429048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 875/1728] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:23.250432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0c1ecf2b-385e-4c17-b98d-fc789354a1d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:23.251291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0c1ecf2b-385e-4c17-b98d-fc789354a1d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:23.257446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0c1ecf2b-385e-4c17-b98d-fc789354a1d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:23.257893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0c1ecf2b-385e-4c17-b98d-fc789354a1d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:23.258689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0c1ecf2b-385e-4c17-b98d-fc789354a1d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:23.259124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0c1ecf2b-385e-4c17-b98d-fc789354a1d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:23.287163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0c1ecf2b-385e-4c17-b98d-fc789354a1d5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040609 Nov 08 17:48:23.287697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 854/1729] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:23.440030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-173f3d77-da3c-4ef8-b5a1-f96b09aa79c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:23.440886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-173f3d77-da3c-4ef8-b5a1-f96b09aa79c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:23.447083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-173f3d77-da3c-4ef8-b5a1-f96b09aa79c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:23.447530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-173f3d77-da3c-4ef8-b5a1-f96b09aa79c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:23.448301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-173f3d77-da3c-4ef8-b5a1-f96b09aa79c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:23.448732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-173f3d77-da3c-4ef8-b5a1-f96b09aa79c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:23.479004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-173f3d77-da3c-4ef8-b5a1-f96b09aa79c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042689 Nov 08 17:48:23.479628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 876/1730] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:24.298454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-40098ab7-d198-4592-a30c-37700be45f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:24.299302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-40098ab7-d198-4592-a30c-37700be45f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:24.305475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-40098ab7-d198-4592-a30c-37700be45f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:24.305917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-40098ab7-d198-4592-a30c-37700be45f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:24.306710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-40098ab7-d198-4592-a30c-37700be45f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:24.307139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-40098ab7-d198-4592-a30c-37700be45f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:24.335263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-40098ab7-d198-4592-a30c-37700be45f19 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Nov 08 17:48:24.335800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 855/1731] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:24.490649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-20dfa14e-fc29-4446-a9cf-c45475694536 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:24.491543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-20dfa14e-fc29-4446-a9cf-c45475694536 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:24.500007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-20dfa14e-fc29-4446-a9cf-c45475694536 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:24.500445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-20dfa14e-fc29-4446-a9cf-c45475694536 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:24.501206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-20dfa14e-fc29-4446-a9cf-c45475694536 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:24.501632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-20dfa14e-fc29-4446-a9cf-c45475694536 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:24.529996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-20dfa14e-fc29-4446-a9cf-c45475694536 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043095 Nov 08 17:48:24.530573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 877/1732] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:25.346761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6f01f2a1-6ad7-4496-aca2-b78a5c68f6fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:25.347613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6f01f2a1-6ad7-4496-aca2-b78a5c68f6fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:25.353707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f01f2a1-6ad7-4496-aca2-b78a5c68f6fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:25.354145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f01f2a1-6ad7-4496-aca2-b78a5c68f6fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:25.354934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f01f2a1-6ad7-4496-aca2-b78a5c68f6fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:25.355362 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f01f2a1-6ad7-4496-aca2-b78a5c68f6fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:25.383393 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6f01f2a1-6ad7-4496-aca2-b78a5c68f6fa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040478 Nov 08 17:48:25.383931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 856/1733] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:25.541014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6db0a221-fe6a-4617-84e1-ce24987b1b13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:25.541920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6db0a221-fe6a-4617-84e1-ce24987b1b13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:25.548259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6db0a221-fe6a-4617-84e1-ce24987b1b13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:25.548706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6db0a221-fe6a-4617-84e1-ce24987b1b13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:25.549481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6db0a221-fe6a-4617-84e1-ce24987b1b13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:25.549930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6db0a221-fe6a-4617-84e1-ce24987b1b13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:25.578979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6db0a221-fe6a-4617-84e1-ce24987b1b13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041723 Nov 08 17:48:25.579535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 878/1734] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:26.395670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b9759b44-5a1a-423b-9245-7d594c51c678 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:26.396579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b9759b44-5a1a-423b-9245-7d594c51c678 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:26.404518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9759b44-5a1a-423b-9245-7d594c51c678 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:26.405076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9759b44-5a1a-423b-9245-7d594c51c678 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:26.405893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9759b44-5a1a-423b-9245-7d594c51c678 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:26.406328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9759b44-5a1a-423b-9245-7d594c51c678 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:26.438594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b9759b44-5a1a-423b-9245-7d594c51c678 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046656 Nov 08 17:48:26.439156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 857/1735] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:26.591217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-125f00a6-4e26-4811-a53e-22d816a79019 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:26.592122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-125f00a6-4e26-4811-a53e-22d816a79019 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:26.598231 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-125f00a6-4e26-4811-a53e-22d816a79019 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:26.598706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-125f00a6-4e26-4811-a53e-22d816a79019 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:26.599463 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-125f00a6-4e26-4811-a53e-22d816a79019 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:26.599889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-125f00a6-4e26-4811-a53e-22d816a79019 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:26.628908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-125f00a6-4e26-4811-a53e-22d816a79019 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042261 Nov 08 17:48:26.629458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 879/1736] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:27.450123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-54518cd2-5fd5-4b96-813d-c2e84095d0ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:27.451047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-54518cd2-5fd5-4b96-813d-c2e84095d0ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:27.457146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-54518cd2-5fd5-4b96-813d-c2e84095d0ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:27.457587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-54518cd2-5fd5-4b96-813d-c2e84095d0ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:27.458344 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-54518cd2-5fd5-4b96-813d-c2e84095d0ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:27.458795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-54518cd2-5fd5-4b96-813d-c2e84095d0ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:27.487706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-54518cd2-5fd5-4b96-813d-c2e84095d0ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Nov 08 17:48:27.488240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 858/1737] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:27.640354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a9eb828f-24b6-4db5-9481-ec3c81a39528 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:27.641334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a9eb828f-24b6-4db5-9481-ec3c81a39528 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:27.647460 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a9eb828f-24b6-4db5-9481-ec3c81a39528 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:27.647909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a9eb828f-24b6-4db5-9481-ec3c81a39528 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:27.648671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a9eb828f-24b6-4db5-9481-ec3c81a39528 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:27.649095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a9eb828f-24b6-4db5-9481-ec3c81a39528 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:27.678062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a9eb828f-24b6-4db5-9481-ec3c81a39528 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041452 Nov 08 17:48:27.678646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 880/1738] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:28.499323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a1afe51c-fa5c-4026-8692-5e00f3d38b4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:28.500246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a1afe51c-fa5c-4026-8692-5e00f3d38b4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:28.506348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a1afe51c-fa5c-4026-8692-5e00f3d38b4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:28.506821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a1afe51c-fa5c-4026-8692-5e00f3d38b4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:28.507582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a1afe51c-fa5c-4026-8692-5e00f3d38b4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:28.508014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a1afe51c-fa5c-4026-8692-5e00f3d38b4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:28.536076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a1afe51c-fa5c-4026-8692-5e00f3d38b4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040968 Nov 08 17:48:28.536635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 859/1739] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:28.689294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-908afd86-2044-4ea1-a977-1ed1851e7407 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:28.690240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-908afd86-2044-4ea1-a977-1ed1851e7407 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:28.696666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908afd86-2044-4ea1-a977-1ed1851e7407 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:28.697113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908afd86-2044-4ea1-a977-1ed1851e7407 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:28.697893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908afd86-2044-4ea1-a977-1ed1851e7407 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:28.698322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908afd86-2044-4ea1-a977-1ed1851e7407 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:28.727950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-908afd86-2044-4ea1-a977-1ed1851e7407 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043164 Nov 08 17:48:28.728526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 881/1740] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:29.547069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2a80ec0f-dd62-4335-9ac3-888d44937f21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:29.547966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2a80ec0f-dd62-4335-9ac3-888d44937f21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:29.554113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2a80ec0f-dd62-4335-9ac3-888d44937f21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:29.554585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2a80ec0f-dd62-4335-9ac3-888d44937f21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:29.555374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2a80ec0f-dd62-4335-9ac3-888d44937f21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:29.555801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2a80ec0f-dd62-4335-9ac3-888d44937f21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:29.585053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2a80ec0f-dd62-4335-9ac3-888d44937f21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Nov 08 17:48:29.585601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 860/1741] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:29.739652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-193ff642-ee0a-4eae-be82-ab9b8d71c6c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:29.740577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-193ff642-ee0a-4eae-be82-ab9b8d71c6c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:29.746770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-193ff642-ee0a-4eae-be82-ab9b8d71c6c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:29.747770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-193ff642-ee0a-4eae-be82-ab9b8d71c6c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:29.748624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-193ff642-ee0a-4eae-be82-ab9b8d71c6c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:29.749086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-193ff642-ee0a-4eae-be82-ab9b8d71c6c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:29.777352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-193ff642-ee0a-4eae-be82-ab9b8d71c6c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041718 Nov 08 17:48:29.777895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 882/1742] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:30.596911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4368076b-f901-4d75-ae12-9ce9555fc850 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:30.597739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4368076b-f901-4d75-ae12-9ce9555fc850 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:30.604074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4368076b-f901-4d75-ae12-9ce9555fc850 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:30.604523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4368076b-f901-4d75-ae12-9ce9555fc850 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:30.605282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4368076b-f901-4d75-ae12-9ce9555fc850 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:30.605709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4368076b-f901-4d75-ae12-9ce9555fc850 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:30.635102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4368076b-f901-4d75-ae12-9ce9555fc850 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 Nov 08 17:48:30.635665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 861/1743] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:30.788511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-22a4a4e9-12e2-48a4-b6a2-f38ccdc6e9b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:30.789409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-22a4a4e9-12e2-48a4-b6a2-f38ccdc6e9b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:30.796277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22a4a4e9-12e2-48a4-b6a2-f38ccdc6e9b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:30.796719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22a4a4e9-12e2-48a4-b6a2-f38ccdc6e9b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:30.797477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22a4a4e9-12e2-48a4-b6a2-f38ccdc6e9b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:30.797902 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22a4a4e9-12e2-48a4-b6a2-f38ccdc6e9b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:30.827749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-22a4a4e9-12e2-48a4-b6a2-f38ccdc6e9b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042858 Nov 08 17:48:30.828316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 883/1744] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:31.646688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ef6c9708-d135-4401-8800-2bb1210ca2f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:31.647499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ef6c9708-d135-4401-8800-2bb1210ca2f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:31.653692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef6c9708-d135-4401-8800-2bb1210ca2f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:31.654132 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef6c9708-d135-4401-8800-2bb1210ca2f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:31.654923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef6c9708-d135-4401-8800-2bb1210ca2f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:31.655351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ef6c9708-d135-4401-8800-2bb1210ca2f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:31.683587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ef6c9708-d135-4401-8800-2bb1210ca2f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040728 Nov 08 17:48:31.684129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 862/1745] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:31.839254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6ab82af5-8a9c-4898-a35d-0b55d25d0e72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:31.840173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6ab82af5-8a9c-4898-a35d-0b55d25d0e72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:31.846409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ab82af5-8a9c-4898-a35d-0b55d25d0e72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:31.846887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ab82af5-8a9c-4898-a35d-0b55d25d0e72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:31.847662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ab82af5-8a9c-4898-a35d-0b55d25d0e72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:31.848101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6ab82af5-8a9c-4898-a35d-0b55d25d0e72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:31.877622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6ab82af5-8a9c-4898-a35d-0b55d25d0e72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042185 Nov 08 17:48:31.878182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 884/1746] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:32.695876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-20176cb5-f03a-4f61-a9e2-f51f0f886b96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:32.696711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-20176cb5-f03a-4f61-a9e2-f51f0f886b96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:32.703583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-20176cb5-f03a-4f61-a9e2-f51f0f886b96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:32.704029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-20176cb5-f03a-4f61-a9e2-f51f0f886b96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:32.704788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-20176cb5-f03a-4f61-a9e2-f51f0f886b96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:32.705216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-20176cb5-f03a-4f61-a9e2-f51f0f886b96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:32.733349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-20176cb5-f03a-4f61-a9e2-f51f0f886b96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041225 Nov 08 17:48:32.734279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 863/1747] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:32.888666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-43f1d0d8-10fe-4cc7-a180-8e526f314c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:32.889591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-43f1d0d8-10fe-4cc7-a180-8e526f314c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:32.896953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43f1d0d8-10fe-4cc7-a180-8e526f314c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:32.897393 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43f1d0d8-10fe-4cc7-a180-8e526f314c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:32.898208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43f1d0d8-10fe-4cc7-a180-8e526f314c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:32.898664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43f1d0d8-10fe-4cc7-a180-8e526f314c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:32.927020 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-43f1d0d8-10fe-4cc7-a180-8e526f314c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042089 Nov 08 17:48:32.927745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 885/1748] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:33.745177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e0dbf0fa-1c81-4fc3-9874-1a8964f45d24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:33.746117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e0dbf0fa-1c81-4fc3-9874-1a8964f45d24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:33.752515 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0dbf0fa-1c81-4fc3-9874-1a8964f45d24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:33.752961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0dbf0fa-1c81-4fc3-9874-1a8964f45d24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:33.753822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0dbf0fa-1c81-4fc3-9874-1a8964f45d24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:33.754253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e0dbf0fa-1c81-4fc3-9874-1a8964f45d24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:33.784243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e0dbf0fa-1c81-4fc3-9874-1a8964f45d24 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042875 Nov 08 17:48:33.784805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 864/1749] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:33.938780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8a44ff4b-350d-470d-a655-30917fb322b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:33.939690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8a44ff4b-350d-470d-a655-30917fb322b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:33.946027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a44ff4b-350d-470d-a655-30917fb322b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:33.946479 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a44ff4b-350d-470d-a655-30917fb322b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:33.947259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a44ff4b-350d-470d-a655-30917fb322b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:33.947715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a44ff4b-350d-470d-a655-30917fb322b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:33.976855 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8a44ff4b-350d-470d-a655-30917fb322b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042256 Nov 08 17:48:33.977398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 886/1750] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 17:48:34.795495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5acda635-c6e2-4520-8031-84c735ab8ada tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:34.796934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5acda635-c6e2-4520-8031-84c735ab8ada tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:34.803177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5acda635-c6e2-4520-8031-84c735ab8ada tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:34.804521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5acda635-c6e2-4520-8031-84c735ab8ada tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:34.804521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5acda635-c6e2-4520-8031-84c735ab8ada tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:34.804835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5acda635-c6e2-4520-8031-84c735ab8ada tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:34.833349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5acda635-c6e2-4520-8031-84c735ab8ada tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041640 Nov 08 17:48:34.833920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 865/1751] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:34.989378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-509342b0-5d2c-42f7-81bf-e87c43eef9e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:34.990329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-509342b0-5d2c-42f7-81bf-e87c43eef9e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:34.996560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-509342b0-5d2c-42f7-81bf-e87c43eef9e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:34.997035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-509342b0-5d2c-42f7-81bf-e87c43eef9e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:34.997809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-509342b0-5d2c-42f7-81bf-e87c43eef9e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:34.998243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-509342b0-5d2c-42f7-81bf-e87c43eef9e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:35.026744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-509342b0-5d2c-42f7-81bf-e87c43eef9e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041372 Nov 08 17:48:35.027295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 887/1752] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:35.844860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1fdc9f0e-37fa-4363-84f7-93f12da27600 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:35.845758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1fdc9f0e-37fa-4363-84f7-93f12da27600 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:35.851957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fdc9f0e-37fa-4363-84f7-93f12da27600 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:35.852395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fdc9f0e-37fa-4363-84f7-93f12da27600 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:35.853155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fdc9f0e-37fa-4363-84f7-93f12da27600 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:35.853583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fdc9f0e-37fa-4363-84f7-93f12da27600 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:35.881973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1fdc9f0e-37fa-4363-84f7-93f12da27600 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Nov 08 17:48:35.882538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 866/1753] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:36.038677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f9a503e0-e505-4104-a2f1-481dc83ffa24 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:36.039582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f9a503e0-e505-4104-a2f1-481dc83ffa24 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:36.045701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9a503e0-e505-4104-a2f1-481dc83ffa24 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:36.046741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9a503e0-e505-4104-a2f1-481dc83ffa24 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:36.047596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9a503e0-e505-4104-a2f1-481dc83ffa24 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:36.048055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9a503e0-e505-4104-a2f1-481dc83ffa24 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:36.077379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f9a503e0-e505-4104-a2f1-481dc83ffa24 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042361 Nov 08 17:48:36.077910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 888/1754] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:36.893710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9108fcbb-bca6-4d67-8a37-6705f47c419f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:36.894551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9108fcbb-bca6-4d67-8a37-6705f47c419f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:36.900364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9108fcbb-bca6-4d67-8a37-6705f47c419f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:36.900808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9108fcbb-bca6-4d67-8a37-6705f47c419f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:36.901564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9108fcbb-bca6-4d67-8a37-6705f47c419f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:36.901987 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9108fcbb-bca6-4d67-8a37-6705f47c419f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:36.930217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9108fcbb-bca6-4d67-8a37-6705f47c419f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040849 Nov 08 17:48:36.930784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 867/1755] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:37.088903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-572c9de3-20f4-42d2-9ea9-61e31c7f994f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:37.089799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-572c9de3-20f4-42d2-9ea9-61e31c7f994f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:37.096739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572c9de3-20f4-42d2-9ea9-61e31c7f994f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:37.097180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572c9de3-20f4-42d2-9ea9-61e31c7f994f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:37.097943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572c9de3-20f4-42d2-9ea9-61e31c7f994f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:37.098375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-572c9de3-20f4-42d2-9ea9-61e31c7f994f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:37.126900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-572c9de3-20f4-42d2-9ea9-61e31c7f994f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041710 Nov 08 17:48:37.127464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 889/1756] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:37.941483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b0879930-bfa9-488a-ae72-03c32c87b738 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:37.942504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b0879930-bfa9-488a-ae72-03c32c87b738 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:37.948658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b0879930-bfa9-488a-ae72-03c32c87b738 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:37.949096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b0879930-bfa9-488a-ae72-03c32c87b738 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:37.949851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b0879930-bfa9-488a-ae72-03c32c87b738 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:37.950275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b0879930-bfa9-488a-ae72-03c32c87b738 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:37.978541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b0879930-bfa9-488a-ae72-03c32c87b738 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040795 Nov 08 17:48:37.979081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 868/1757] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:38.137823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c4cdadb5-f72c-4b56-998f-0683f8cd5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:38.138759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c4cdadb5-f72c-4b56-998f-0683f8cd5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:38.144856 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4cdadb5-f72c-4b56-998f-0683f8cd5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:38.145251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4cdadb5-f72c-4b56-998f-0683f8cd5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:38.146018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4cdadb5-f72c-4b56-998f-0683f8cd5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:38.146454 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4cdadb5-f72c-4b56-998f-0683f8cd5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:38.175614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c4cdadb5-f72c-4b56-998f-0683f8cd5724 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041723 Nov 08 17:48:38.176163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 890/1758] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:38.990793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-98b47fb7-ea65-4fd5-ac74-acd0aac3ef25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:38.991925 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-98b47fb7-ea65-4fd5-ac74-acd0aac3ef25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:38.997873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98b47fb7-ea65-4fd5-ac74-acd0aac3ef25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:38.998317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98b47fb7-ea65-4fd5-ac74-acd0aac3ef25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:38.999124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98b47fb7-ea65-4fd5-ac74-acd0aac3ef25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:38.999580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98b47fb7-ea65-4fd5-ac74-acd0aac3ef25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:39.027647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-98b47fb7-ea65-4fd5-ac74-acd0aac3ef25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040748 Nov 08 17:48:39.028197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 869/1759] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:39.187083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f53e7bcc-794e-4b62-a400-28dc9c044385 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:39.187973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f53e7bcc-794e-4b62-a400-28dc9c044385 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:39.194214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f53e7bcc-794e-4b62-a400-28dc9c044385 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:39.194690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f53e7bcc-794e-4b62-a400-28dc9c044385 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:39.195448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f53e7bcc-794e-4b62-a400-28dc9c044385 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:39.195877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f53e7bcc-794e-4b62-a400-28dc9c044385 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:39.224713 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f53e7bcc-794e-4b62-a400-28dc9c044385 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041412 Nov 08 17:48:39.225249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 891/1760] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:40.039273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2b223317-b5b1-47bd-9617-8c39c6441328 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:40.040195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2b223317-b5b1-47bd-9617-8c39c6441328 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:40.046968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b223317-b5b1-47bd-9617-8c39c6441328 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:40.047405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b223317-b5b1-47bd-9617-8c39c6441328 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:40.048158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b223317-b5b1-47bd-9617-8c39c6441328 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:40.048586 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b223317-b5b1-47bd-9617-8c39c6441328 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:40.076583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2b223317-b5b1-47bd-9617-8c39c6441328 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041010 Nov 08 17:48:40.077113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 870/1761] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:40.237048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-032712ae-a5b6-495d-9ed3-d714a8b8207d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:40.237952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-032712ae-a5b6-495d-9ed3-d714a8b8207d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:40.244218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-032712ae-a5b6-495d-9ed3-d714a8b8207d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:40.244612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-032712ae-a5b6-495d-9ed3-d714a8b8207d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:40.245385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-032712ae-a5b6-495d-9ed3-d714a8b8207d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:40.245819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-032712ae-a5b6-495d-9ed3-d714a8b8207d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:40.273695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-032712ae-a5b6-495d-9ed3-d714a8b8207d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041338 Nov 08 17:48:40.274230 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 892/1762] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:41.087827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6da264fc-50fa-448d-8043-68eedc1fdfa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:41.088733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6da264fc-50fa-448d-8043-68eedc1fdfa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:41.095083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6da264fc-50fa-448d-8043-68eedc1fdfa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:41.095538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6da264fc-50fa-448d-8043-68eedc1fdfa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:41.096332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6da264fc-50fa-448d-8043-68eedc1fdfa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:41.096760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6da264fc-50fa-448d-8043-68eedc1fdfa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:41.125530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6da264fc-50fa-448d-8043-68eedc1fdfa0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041403 Nov 08 17:48:41.126076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 871/1763] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:41.285122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6c9b0163-6cc0-4049-9954-62eb495337af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:41.285952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6c9b0163-6cc0-4049-9954-62eb495337af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:41.292117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6c9b0163-6cc0-4049-9954-62eb495337af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:41.292557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6c9b0163-6cc0-4049-9954-62eb495337af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:41.293321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6c9b0163-6cc0-4049-9954-62eb495337af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:41.293745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6c9b0163-6cc0-4049-9954-62eb495337af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:41.323308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6c9b0163-6cc0-4049-9954-62eb495337af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042146 Nov 08 17:48:41.323867 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 893/1764] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:42.136817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1fc5a377-cddc-40c7-b67b-e70d34d68dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:42.137721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1fc5a377-cddc-40c7-b67b-e70d34d68dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:42.144650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fc5a377-cddc-40c7-b67b-e70d34d68dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:42.145096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fc5a377-cddc-40c7-b67b-e70d34d68dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:42.145857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fc5a377-cddc-40c7-b67b-e70d34d68dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:42.146282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fc5a377-cddc-40c7-b67b-e70d34d68dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:42.175106 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1fc5a377-cddc-40c7-b67b-e70d34d68dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042083 Nov 08 17:48:42.175652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 872/1765] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:42.335028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2abe830c-832d-4b42-a21c-98fdce67b11c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:42.335960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2abe830c-832d-4b42-a21c-98fdce67b11c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:42.342121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2abe830c-832d-4b42-a21c-98fdce67b11c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:42.342637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2abe830c-832d-4b42-a21c-98fdce67b11c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:42.343401 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2abe830c-832d-4b42-a21c-98fdce67b11c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:42.344375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2abe830c-832d-4b42-a21c-98fdce67b11c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:42.373397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2abe830c-832d-4b42-a21c-98fdce67b11c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042292 Nov 08 17:48:42.373940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 894/1766] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:43.186317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-665f0f35-14e6-4560-8328-c23a343e8156 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:43.187240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-665f0f35-14e6-4560-8328-c23a343e8156 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:43.193804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-665f0f35-14e6-4560-8328-c23a343e8156 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:43.194247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-665f0f35-14e6-4560-8328-c23a343e8156 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:43.195040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-665f0f35-14e6-4560-8328-c23a343e8156 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:43.195471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-665f0f35-14e6-4560-8328-c23a343e8156 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:43.224248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-665f0f35-14e6-4560-8328-c23a343e8156 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041724 Nov 08 17:48:43.224788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 873/1767] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:43.385716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-76013758-a4dd-4cda-b3cb-715fcdaadf20 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:43.386664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-76013758-a4dd-4cda-b3cb-715fcdaadf20 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:43.393489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76013758-a4dd-4cda-b3cb-715fcdaadf20 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:43.393939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76013758-a4dd-4cda-b3cb-715fcdaadf20 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:43.394752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76013758-a4dd-4cda-b3cb-715fcdaadf20 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:43.395190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-76013758-a4dd-4cda-b3cb-715fcdaadf20 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:43.422925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-76013758-a4dd-4cda-b3cb-715fcdaadf20 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041841 Nov 08 17:48:43.423482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 895/1768] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:44.236008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2af9a646-4f03-4cf1-bb4b-58e07582229c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:44.236904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2af9a646-4f03-4cf1-bb4b-58e07582229c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:44.243142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2af9a646-4f03-4cf1-bb4b-58e07582229c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:44.243521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2af9a646-4f03-4cf1-bb4b-58e07582229c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:44.244274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2af9a646-4f03-4cf1-bb4b-58e07582229c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:44.244728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2af9a646-4f03-4cf1-bb4b-58e07582229c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:44.273242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2af9a646-4f03-4cf1-bb4b-58e07582229c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Nov 08 17:48:44.273782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 874/1769] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:44.434289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c703007c-e0c5-4118-975b-f506b2528202 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:44.435226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c703007c-e0c5-4118-975b-f506b2528202 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:44.442178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c703007c-e0c5-4118-975b-f506b2528202 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:44.442699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c703007c-e0c5-4118-975b-f506b2528202 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:44.443476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c703007c-e0c5-4118-975b-f506b2528202 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:44.443909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c703007c-e0c5-4118-975b-f506b2528202 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:44.471556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c703007c-e0c5-4118-975b-f506b2528202 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041014 Nov 08 17:48:44.472099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 896/1770] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:45.285430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-30ec6eaa-bf89-4a27-86d1-bc8756f7ff11 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:45.286261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-30ec6eaa-bf89-4a27-86d1-bc8756f7ff11 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:45.292533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-30ec6eaa-bf89-4a27-86d1-bc8756f7ff11 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:45.293002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-30ec6eaa-bf89-4a27-86d1-bc8756f7ff11 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:45.293774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-30ec6eaa-bf89-4a27-86d1-bc8756f7ff11 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:45.294200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-30ec6eaa-bf89-4a27-86d1-bc8756f7ff11 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:45.322318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-30ec6eaa-bf89-4a27-86d1-bc8756f7ff11 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 Nov 08 17:48:45.322978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 875/1771] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:45.482913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ace2293e-4576-45a8-a913-12f36db2f917 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:45.483802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ace2293e-4576-45a8-a913-12f36db2f917 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:45.490585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ace2293e-4576-45a8-a913-12f36db2f917 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:45.491027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ace2293e-4576-45a8-a913-12f36db2f917 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:45.491789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ace2293e-4576-45a8-a913-12f36db2f917 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:45.492220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ace2293e-4576-45a8-a913-12f36db2f917 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:45.521282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ace2293e-4576-45a8-a913-12f36db2f917 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042123 Nov 08 17:48:45.521816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 897/1772] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:46.334315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-449e0d5c-6109-46e9-b8fa-58d7f7c6faec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:46.335164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-449e0d5c-6109-46e9-b8fa-58d7f7c6faec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:46.341326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-449e0d5c-6109-46e9-b8fa-58d7f7c6faec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:46.341763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-449e0d5c-6109-46e9-b8fa-58d7f7c6faec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:46.342574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-449e0d5c-6109-46e9-b8fa-58d7f7c6faec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:46.343002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-449e0d5c-6109-46e9-b8fa-58d7f7c6faec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:46.371032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-449e0d5c-6109-46e9-b8fa-58d7f7c6faec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040553 Nov 08 17:48:46.371575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 876/1773] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:46.532020 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-16583154-ff44-48b7-b596-33b8ad07dd78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:46.532909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-16583154-ff44-48b7-b596-33b8ad07dd78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:46.539068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-16583154-ff44-48b7-b596-33b8ad07dd78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:46.539513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-16583154-ff44-48b7-b596-33b8ad07dd78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:46.540273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-16583154-ff44-48b7-b596-33b8ad07dd78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:46.540734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-16583154-ff44-48b7-b596-33b8ad07dd78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:46.569427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-16583154-ff44-48b7-b596-33b8ad07dd78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041275 Nov 08 17:48:46.569971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 898/1774] 10.222.0.18 () {60 vars in 1342 bytes} [Mon Nov 8 17:48:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 17:48:47.382213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f671bc12-88ed-4b12-98f8-f74762311a74 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:47.383150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f671bc12-88ed-4b12-98f8-f74762311a74 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:47.389315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f671bc12-88ed-4b12-98f8-f74762311a74 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:47.389761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f671bc12-88ed-4b12-98f8-f74762311a74 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:47.390557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f671bc12-88ed-4b12-98f8-f74762311a74 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:47.390987 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f671bc12-88ed-4b12-98f8-f74762311a74 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:47.418741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f671bc12-88ed-4b12-98f8-f74762311a74 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040203 Nov 08 17:48:47.419283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 877/1775] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:47.581270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:48:47.582178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:47.588377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:47.588824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:47.589600 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:47.590036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:47.616022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [8b8a761b-b175-42bc-b483-2d3f163b9e19] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 08 17:48:48.432872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e5758a49-13d8-4217-9fde-1cf19db76dda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:48.433773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e5758a49-13d8-4217-9fde-1cf19db76dda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:48.440058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5758a49-13d8-4217-9fde-1cf19db76dda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:48.440499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5758a49-13d8-4217-9fde-1cf19db76dda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:48.441268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5758a49-13d8-4217-9fde-1cf19db76dda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:48.441700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5758a49-13d8-4217-9fde-1cf19db76dda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:48.469559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e5758a49-13d8-4217-9fde-1cf19db76dda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039940 Nov 08 17:48:48.470103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 878/1776] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:48:48.631918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [8b8a761b-b175-42bc-b483-2d3f163b9e19] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 50988. Nov 08 17:48:48.690023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8df4f45f-b6b1-4896-996a-d86463951d13 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action" status: 200 len: 38186 microversion: 2.20 time: 1.112930 Nov 08 17:48:48.690731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 899/1777] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 17:48:47 2021] POST /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1/action => generated 38186 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:48:49.480444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0465108c-0506-40a0-b53d-6c0bd5d96257 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:49.481339 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0465108c-0506-40a0-b53d-6c0bd5d96257 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:49.488348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0465108c-0506-40a0-b53d-6c0bd5d96257 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:49.488782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0465108c-0506-40a0-b53d-6c0bd5d96257 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:49.489565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0465108c-0506-40a0-b53d-6c0bd5d96257 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:49.489992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0465108c-0506-40a0-b53d-6c0bd5d96257 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:49.519036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0465108c-0506-40a0-b53d-6c0bd5d96257 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Nov 08 17:48:49.519580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 879/1778] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:50.441359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:48:50.441514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:48:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:48:50.530725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6f77f126-05ce-4d4c-b31a-c4a67cfd6f01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:50.532489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6f77f126-05ce-4d4c-b31a-c4a67cfd6f01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:50.539328 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f77f126-05ce-4d4c-b31a-c4a67cfd6f01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:50.539777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f77f126-05ce-4d4c-b31a-c4a67cfd6f01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:50.540578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f77f126-05ce-4d4c-b31a-c4a67cfd6f01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:50.541012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f77f126-05ce-4d4c-b31a-c4a67cfd6f01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:50.570012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6f77f126-05ce-4d4c-b31a-c4a67cfd6f01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Nov 08 17:48:50.570572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 900/1779] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:51.581091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ccb0c9f1-2f44-49bb-b4aa-d38e06461a00 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:51.581934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ccb0c9f1-2f44-49bb-b4aa-d38e06461a00 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:51.588107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccb0c9f1-2f44-49bb-b4aa-d38e06461a00 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:51.588545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccb0c9f1-2f44-49bb-b4aa-d38e06461a00 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:51.589386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccb0c9f1-2f44-49bb-b4aa-d38e06461a00 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:51.589815 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccb0c9f1-2f44-49bb-b4aa-d38e06461a00 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:51.618376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ccb0c9f1-2f44-49bb-b4aa-d38e06461a00 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041135 Nov 08 17:48:51.618948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 880/1780] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:52.629661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8baa11b8-f7ff-4c8f-8794-1e873984b08f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:52.630620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8baa11b8-f7ff-4c8f-8794-1e873984b08f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:52.637096 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8baa11b8-f7ff-4c8f-8794-1e873984b08f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:52.637554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8baa11b8-f7ff-4c8f-8794-1e873984b08f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:52.638339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8baa11b8-f7ff-4c8f-8794-1e873984b08f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:52.638816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8baa11b8-f7ff-4c8f-8794-1e873984b08f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:52.667413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8baa11b8-f7ff-4c8f-8794-1e873984b08f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042128 Nov 08 17:48:52.667982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 901/1781] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:53.678186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-37bbb8d6-ebe1-4b52-8951-1afcd831b2dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:53.679131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-37bbb8d6-ebe1-4b52-8951-1afcd831b2dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:53.685225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-37bbb8d6-ebe1-4b52-8951-1afcd831b2dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:53.685662 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-37bbb8d6-ebe1-4b52-8951-1afcd831b2dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:53.686555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-37bbb8d6-ebe1-4b52-8951-1afcd831b2dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:53.686986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-37bbb8d6-ebe1-4b52-8951-1afcd831b2dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:53.716116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-37bbb8d6-ebe1-4b52-8951-1afcd831b2dc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041612 Nov 08 17:48:53.716667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 881/1782] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:54.727999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-869cbb7a-fc1e-4cb4-9f59-2d545a414319 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:54.728940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-869cbb7a-fc1e-4cb4-9f59-2d545a414319 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:54.735366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-869cbb7a-fc1e-4cb4-9f59-2d545a414319 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:54.736066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-869cbb7a-fc1e-4cb4-9f59-2d545a414319 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:54.736837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-869cbb7a-fc1e-4cb4-9f59-2d545a414319 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:54.737289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-869cbb7a-fc1e-4cb4-9f59-2d545a414319 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:54.768621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-869cbb7a-fc1e-4cb4-9f59-2d545a414319 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Nov 08 17:48:54.769216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 902/1783] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:55.779928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-17b78292-9814-45fe-88e9-f9276037ffec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:55.780828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-17b78292-9814-45fe-88e9-f9276037ffec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:55.787076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17b78292-9814-45fe-88e9-f9276037ffec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:55.787509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17b78292-9814-45fe-88e9-f9276037ffec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:55.788273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17b78292-9814-45fe-88e9-f9276037ffec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:55.788692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17b78292-9814-45fe-88e9-f9276037ffec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:55.818043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-17b78292-9814-45fe-88e9-f9276037ffec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041689 Nov 08 17:48:55.818718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 882/1784] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:56.829646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8788006b-83ed-4f02-8ec2-4f02cbe72526 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:56.830609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8788006b-83ed-4f02-8ec2-4f02cbe72526 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:56.836841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8788006b-83ed-4f02-8ec2-4f02cbe72526 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:56.837294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8788006b-83ed-4f02-8ec2-4f02cbe72526 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:56.838072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8788006b-83ed-4f02-8ec2-4f02cbe72526 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:56.838531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8788006b-83ed-4f02-8ec2-4f02cbe72526 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:56.867814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8788006b-83ed-4f02-8ec2-4f02cbe72526 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042546 Nov 08 17:48:56.868381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 903/1785] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:57.882891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f8679f7b-aef5-470f-a0e0-25a133fa69ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:57.885063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f8679f7b-aef5-470f-a0e0-25a133fa69ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:57.892546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8679f7b-aef5-470f-a0e0-25a133fa69ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:57.892987 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8679f7b-aef5-470f-a0e0-25a133fa69ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:57.893757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8679f7b-aef5-470f-a0e0-25a133fa69ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:57.894749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8679f7b-aef5-470f-a0e0-25a133fa69ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:57.925159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f8679f7b-aef5-470f-a0e0-25a133fa69ef tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049432 Nov 08 17:48:57.925902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 883/1786] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:58.936493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-33d29005-aad5-4765-a66b-86f809dd9163 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:58.937337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-33d29005-aad5-4765-a66b-86f809dd9163 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:58.943902 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-33d29005-aad5-4765-a66b-86f809dd9163 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:58.944352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-33d29005-aad5-4765-a66b-86f809dd9163 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:58.945521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-33d29005-aad5-4765-a66b-86f809dd9163 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:58.945627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-33d29005-aad5-4765-a66b-86f809dd9163 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:58.975587 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-33d29005-aad5-4765-a66b-86f809dd9163 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042899 Nov 08 17:48:58.976170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 904/1787] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:48:59.986334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f0edc573-c8ee-4f5f-bb6d-262e804efe96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:48:59.987264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f0edc573-c8ee-4f5f-bb6d-262e804efe96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:48:59.993520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0edc573-c8ee-4f5f-bb6d-262e804efe96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:59.993957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0edc573-c8ee-4f5f-bb6d-262e804efe96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:48:59.994763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0edc573-c8ee-4f5f-bb6d-262e804efe96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:48:59.995189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0edc573-c8ee-4f5f-bb6d-262e804efe96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:00.023378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f0edc573-c8ee-4f5f-bb6d-262e804efe96 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041103 Nov 08 17:49:00.023921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 884/1788] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:48:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:01.034791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4b5f27ef-04f4-4a31-98e8-897de0bae463 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:01.035699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4b5f27ef-04f4-4a31-98e8-897de0bae463 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:01.041930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b5f27ef-04f4-4a31-98e8-897de0bae463 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:01.042374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b5f27ef-04f4-4a31-98e8-897de0bae463 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:01.043180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b5f27ef-04f4-4a31-98e8-897de0bae463 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:01.043612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4b5f27ef-04f4-4a31-98e8-897de0bae463 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:01.072354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4b5f27ef-04f4-4a31-98e8-897de0bae463 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041304 Nov 08 17:49:01.072901 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 905/1789] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:02.084346 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-455895ba-b105-4683-90a4-246eff8ad78f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:02.085239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-455895ba-b105-4683-90a4-246eff8ad78f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:02.091407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-455895ba-b105-4683-90a4-246eff8ad78f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:02.091851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-455895ba-b105-4683-90a4-246eff8ad78f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:02.092610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-455895ba-b105-4683-90a4-246eff8ad78f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:02.093034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-455895ba-b105-4683-90a4-246eff8ad78f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:02.133800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-455895ba-b105-4683-90a4-246eff8ad78f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053168 Nov 08 17:49:02.134430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 885/1790] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:03.145981 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-facf681c-8ff1-4701-8dad-8f70e589e76d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:03.146915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-facf681c-8ff1-4701-8dad-8f70e589e76d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:03.153180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-facf681c-8ff1-4701-8dad-8f70e589e76d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:03.153566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-facf681c-8ff1-4701-8dad-8f70e589e76d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:03.154338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-facf681c-8ff1-4701-8dad-8f70e589e76d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:03.154805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-facf681c-8ff1-4701-8dad-8f70e589e76d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:03.183450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-facf681c-8ff1-4701-8dad-8f70e589e76d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041876 Nov 08 17:49:03.183997 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 906/1791] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:04.194693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1d859ad2-9b9e-44dc-bde7-f5a21acdac99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:04.195589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1d859ad2-9b9e-44dc-bde7-f5a21acdac99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:04.201734 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1d859ad2-9b9e-44dc-bde7-f5a21acdac99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:04.202168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1d859ad2-9b9e-44dc-bde7-f5a21acdac99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:04.202951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1d859ad2-9b9e-44dc-bde7-f5a21acdac99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:04.203375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1d859ad2-9b9e-44dc-bde7-f5a21acdac99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:04.231637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1d859ad2-9b9e-44dc-bde7-f5a21acdac99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040718 Nov 08 17:49:04.232177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 886/1792] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:05.243251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4f91b2f1-7bbf-48f7-9e9c-bb633fd40971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:05.244084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4f91b2f1-7bbf-48f7-9e9c-bb633fd40971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:05.250313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f91b2f1-7bbf-48f7-9e9c-bb633fd40971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:05.251513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f91b2f1-7bbf-48f7-9e9c-bb633fd40971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:05.252307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f91b2f1-7bbf-48f7-9e9c-bb633fd40971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:05.252753 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4f91b2f1-7bbf-48f7-9e9c-bb633fd40971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:05.284889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4f91b2f1-7bbf-48f7-9e9c-bb633fd40971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 Nov 08 17:49:05.285485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 907/1793] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:06.295649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-52250349-c3af-4175-aafa-4d034c9c7c89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:06.296544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-52250349-c3af-4175-aafa-4d034c9c7c89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:06.303218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52250349-c3af-4175-aafa-4d034c9c7c89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:06.303656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52250349-c3af-4175-aafa-4d034c9c7c89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:06.304416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52250349-c3af-4175-aafa-4d034c9c7c89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:06.304844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52250349-c3af-4175-aafa-4d034c9c7c89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:06.340881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-52250349-c3af-4175-aafa-4d034c9c7c89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048616 Nov 08 17:49:06.341813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 887/1794] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:07.354395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6d921f3d-325e-4427-bb8f-f8f6eb6cd13a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:07.355335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6d921f3d-325e-4427-bb8f-f8f6eb6cd13a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:07.361824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d921f3d-325e-4427-bb8f-f8f6eb6cd13a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:07.362269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d921f3d-325e-4427-bb8f-f8f6eb6cd13a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:07.363078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d921f3d-325e-4427-bb8f-f8f6eb6cd13a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:07.363518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d921f3d-325e-4427-bb8f-f8f6eb6cd13a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:07.392361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6d921f3d-325e-4427-bb8f-f8f6eb6cd13a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040992 Nov 08 17:49:07.392919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 908/1795] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:08.403601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-14208241-6474-4f6e-8ad2-9710b507813f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:08.404517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-14208241-6474-4f6e-8ad2-9710b507813f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:08.411187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14208241-6474-4f6e-8ad2-9710b507813f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:08.411639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14208241-6474-4f6e-8ad2-9710b507813f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:08.412441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14208241-6474-4f6e-8ad2-9710b507813f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:08.412909 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14208241-6474-4f6e-8ad2-9710b507813f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:08.441651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-14208241-6474-4f6e-8ad2-9710b507813f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Nov 08 17:49:08.442288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 888/1796] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:09.453018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bd7bcfcb-c465-4992-945f-ed9afbb4dd99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:09.453927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bd7bcfcb-c465-4992-945f-ed9afbb4dd99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:09.460057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bd7bcfcb-c465-4992-945f-ed9afbb4dd99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:09.460496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bd7bcfcb-c465-4992-945f-ed9afbb4dd99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:09.461260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bd7bcfcb-c465-4992-945f-ed9afbb4dd99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:09.461690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bd7bcfcb-c465-4992-945f-ed9afbb4dd99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:09.490135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bd7bcfcb-c465-4992-945f-ed9afbb4dd99 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040941 Nov 08 17:49:09.490708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 909/1797] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:10.502064 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d602a6e2-cd43-4072-b853-05e685d3be9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:10.502991 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d602a6e2-cd43-4072-b853-05e685d3be9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:10.509195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d602a6e2-cd43-4072-b853-05e685d3be9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:10.509637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d602a6e2-cd43-4072-b853-05e685d3be9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:10.510402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d602a6e2-cd43-4072-b853-05e685d3be9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:10.510861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d602a6e2-cd43-4072-b853-05e685d3be9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:10.539035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d602a6e2-cd43-4072-b853-05e685d3be9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041430 Nov 08 17:49:10.539574 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 889/1798] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:11.550038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ba5e55cf-c444-4dc3-af02-923aa66438d4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:11.550969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ba5e55cf-c444-4dc3-af02-923aa66438d4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:11.557211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba5e55cf-c444-4dc3-af02-923aa66438d4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:11.557653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba5e55cf-c444-4dc3-af02-923aa66438d4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:11.558416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba5e55cf-c444-4dc3-af02-923aa66438d4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:11.558870 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ba5e55cf-c444-4dc3-af02-923aa66438d4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:11.588569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ba5e55cf-c444-4dc3-af02-923aa66438d4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Nov 08 17:49:11.589113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 910/1799] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:12.599935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1fde3eea-4303-4164-88d7-d719f44c4e82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:12.600839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1fde3eea-4303-4164-88d7-d719f44c4e82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:12.607042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fde3eea-4303-4164-88d7-d719f44c4e82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:12.607485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fde3eea-4303-4164-88d7-d719f44c4e82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:12.608252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fde3eea-4303-4164-88d7-d719f44c4e82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:12.608682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fde3eea-4303-4164-88d7-d719f44c4e82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:12.637729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1fde3eea-4303-4164-88d7-d719f44c4e82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Nov 08 17:49:12.638361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 890/1800] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:13.649447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a63f6526-fe0c-47a1-b4e1-e5c5cee35a2c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:13.650353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a63f6526-fe0c-47a1-b4e1-e5c5cee35a2c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:13.656699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a63f6526-fe0c-47a1-b4e1-e5c5cee35a2c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:13.657150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a63f6526-fe0c-47a1-b4e1-e5c5cee35a2c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:13.657923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a63f6526-fe0c-47a1-b4e1-e5c5cee35a2c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:13.658356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a63f6526-fe0c-47a1-b4e1-e5c5cee35a2c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:13.686558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a63f6526-fe0c-47a1-b4e1-e5c5cee35a2c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040808 Nov 08 17:49:13.687102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 911/1801] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:14.698495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c02456ac-b313-4eeb-82db-84953df35073 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:14.699455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c02456ac-b313-4eeb-82db-84953df35073 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:14.706146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c02456ac-b313-4eeb-82db-84953df35073 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:14.706622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c02456ac-b313-4eeb-82db-84953df35073 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:14.707449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c02456ac-b313-4eeb-82db-84953df35073 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:14.707881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c02456ac-b313-4eeb-82db-84953df35073 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:14.742275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c02456ac-b313-4eeb-82db-84953df35073 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047602 Nov 08 17:49:14.742862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 891/1802] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:15.754102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cfd73aca-5acc-49d1-a233-f401912a87f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:15.755057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cfd73aca-5acc-49d1-a233-f401912a87f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:15.761241 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cfd73aca-5acc-49d1-a233-f401912a87f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:15.761686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cfd73aca-5acc-49d1-a233-f401912a87f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:15.762480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cfd73aca-5acc-49d1-a233-f401912a87f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:15.762944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cfd73aca-5acc-49d1-a233-f401912a87f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:15.791549 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cfd73aca-5acc-49d1-a233-f401912a87f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041837 Nov 08 17:49:15.792109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 912/1803] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:16.802271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-50502a3d-13bb-4f71-a17a-bb50fbc6aaa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:16.803228 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-50502a3d-13bb-4f71-a17a-bb50fbc6aaa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:16.809415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50502a3d-13bb-4f71-a17a-bb50fbc6aaa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:16.809882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50502a3d-13bb-4f71-a17a-bb50fbc6aaa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:16.810680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50502a3d-13bb-4f71-a17a-bb50fbc6aaa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:16.811113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50502a3d-13bb-4f71-a17a-bb50fbc6aaa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:16.841203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-50502a3d-13bb-4f71-a17a-bb50fbc6aaa7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042612 Nov 08 17:49:16.841763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 892/1804] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:17.852622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ca9ffb51-4b22-4167-92fd-60d197597c51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:17.853530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ca9ffb51-4b22-4167-92fd-60d197597c51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:17.859749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca9ffb51-4b22-4167-92fd-60d197597c51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:17.860464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca9ffb51-4b22-4167-92fd-60d197597c51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:17.861220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca9ffb51-4b22-4167-92fd-60d197597c51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:17.861654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca9ffb51-4b22-4167-92fd-60d197597c51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:17.890484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ca9ffb51-4b22-4167-92fd-60d197597c51 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 Nov 08 17:49:17.895508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 913/1805] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:18.903119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3d8d3fe8-a2f1-4fbc-ae03-4fd4ddc844df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:18.903940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3d8d3fe8-a2f1-4fbc-ae03-4fd4ddc844df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:18.910769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d8d3fe8-a2f1-4fbc-ae03-4fd4ddc844df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:18.911208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d8d3fe8-a2f1-4fbc-ae03-4fd4ddc844df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:18.911967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d8d3fe8-a2f1-4fbc-ae03-4fd4ddc844df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:18.912390 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d8d3fe8-a2f1-4fbc-ae03-4fd4ddc844df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:18.940554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3d8d3fe8-a2f1-4fbc-ae03-4fd4ddc844df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041292 Nov 08 17:49:18.941099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 893/1806] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:19.952132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-77260c62-bf5c-471e-8e81-e7f288904a7b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:19.953175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-77260c62-bf5c-471e-8e81-e7f288904a7b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:19.962274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77260c62-bf5c-471e-8e81-e7f288904a7b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:19.963126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77260c62-bf5c-471e-8e81-e7f288904a7b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:19.964537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77260c62-bf5c-471e-8e81-e7f288904a7b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:19.965387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77260c62-bf5c-471e-8e81-e7f288904a7b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:20.016951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-77260c62-bf5c-471e-8e81-e7f288904a7b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068616 Nov 08 17:49:20.017509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 914/1807] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:21.027380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7d24ab8f-320f-4c80-9c08-3bc9b997e832 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:21.028295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7d24ab8f-320f-4c80-9c08-3bc9b997e832 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:21.035364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d24ab8f-320f-4c80-9c08-3bc9b997e832 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:21.035811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d24ab8f-320f-4c80-9c08-3bc9b997e832 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:21.036586 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d24ab8f-320f-4c80-9c08-3bc9b997e832 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:21.037013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d24ab8f-320f-4c80-9c08-3bc9b997e832 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:21.066895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7d24ab8f-320f-4c80-9c08-3bc9b997e832 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043191 Nov 08 17:49:21.067438 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 894/1808] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:22.077990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5bca071a-d04e-4c06-aa5a-8bdc36f26171 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:22.079554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5bca071a-d04e-4c06-aa5a-8bdc36f26171 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:22.085747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5bca071a-d04e-4c06-aa5a-8bdc36f26171 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:22.086195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5bca071a-d04e-4c06-aa5a-8bdc36f26171 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:22.087003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5bca071a-d04e-4c06-aa5a-8bdc36f26171 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:22.087446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5bca071a-d04e-4c06-aa5a-8bdc36f26171 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:22.116133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5bca071a-d04e-4c06-aa5a-8bdc36f26171 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Nov 08 17:49:22.116678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 915/1809] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:23.127265 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d8829dfb-ad3b-474a-be05-881ee017d162 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:23.128174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d8829dfb-ad3b-474a-be05-881ee017d162 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:23.134287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d8829dfb-ad3b-474a-be05-881ee017d162 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:23.137230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d8829dfb-ad3b-474a-be05-881ee017d162 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:23.138953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d8829dfb-ad3b-474a-be05-881ee017d162 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:23.139405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d8829dfb-ad3b-474a-be05-881ee017d162 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:23.169192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d8829dfb-ad3b-474a-be05-881ee017d162 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045752 Nov 08 17:49:23.169727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 895/1810] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:24.180909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5980c517-bc30-4f74-bfd3-b10d957c32c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:24.181823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5980c517-bc30-4f74-bfd3-b10d957c32c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:24.189197 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5980c517-bc30-4f74-bfd3-b10d957c32c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:24.189658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5980c517-bc30-4f74-bfd3-b10d957c32c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:24.190447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5980c517-bc30-4f74-bfd3-b10d957c32c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:24.190907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5980c517-bc30-4f74-bfd3-b10d957c32c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:24.220449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5980c517-bc30-4f74-bfd3-b10d957c32c5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Nov 08 17:49:24.221017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 916/1811] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:25.231678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-938da5c4-15ea-4615-8868-761717c0c81a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:25.232580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-938da5c4-15ea-4615-8868-761717c0c81a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:25.239268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-938da5c4-15ea-4615-8868-761717c0c81a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:25.239713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-938da5c4-15ea-4615-8868-761717c0c81a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:25.240474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-938da5c4-15ea-4615-8868-761717c0c81a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:25.240901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-938da5c4-15ea-4615-8868-761717c0c81a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:25.269961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-938da5c4-15ea-4615-8868-761717c0c81a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Nov 08 17:49:25.270431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 896/1812] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:26.282037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-157c46b1-feeb-4750-8ca8-31abe5e54a90 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:26.283326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-157c46b1-feeb-4750-8ca8-31abe5e54a90 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:26.289778 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-157c46b1-feeb-4750-8ca8-31abe5e54a90 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:26.290217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-157c46b1-feeb-4750-8ca8-31abe5e54a90 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:26.291012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-157c46b1-feeb-4750-8ca8-31abe5e54a90 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:26.291444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-157c46b1-feeb-4750-8ca8-31abe5e54a90 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:26.319121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-157c46b1-feeb-4750-8ca8-31abe5e54a90 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041828 Nov 08 17:49:26.319667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 917/1813] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:27.330517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e63973e0-6c50-4200-b2be-0cf33621d253 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:27.331418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e63973e0-6c50-4200-b2be-0cf33621d253 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:27.337521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e63973e0-6c50-4200-b2be-0cf33621d253 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:27.337957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e63973e0-6c50-4200-b2be-0cf33621d253 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:27.338741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e63973e0-6c50-4200-b2be-0cf33621d253 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:27.339166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e63973e0-6c50-4200-b2be-0cf33621d253 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:27.368164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e63973e0-6c50-4200-b2be-0cf33621d253 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041395 Nov 08 17:49:27.368700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 897/1814] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:28.379900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d34328f6-b195-4fc1-bc9d-0a793e4fba8c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:28.380809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d34328f6-b195-4fc1-bc9d-0a793e4fba8c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:28.387036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d34328f6-b195-4fc1-bc9d-0a793e4fba8c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:28.387484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d34328f6-b195-4fc1-bc9d-0a793e4fba8c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:28.388251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d34328f6-b195-4fc1-bc9d-0a793e4fba8c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:28.388682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d34328f6-b195-4fc1-bc9d-0a793e4fba8c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:28.417241 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d34328f6-b195-4fc1-bc9d-0a793e4fba8c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041083 Nov 08 17:49:28.417777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 918/1815] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:29.428254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-85c165a9-0bcc-4d3b-86fa-c47ed9e0f379 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:29.429164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-85c165a9-0bcc-4d3b-86fa-c47ed9e0f379 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:29.435266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85c165a9-0bcc-4d3b-86fa-c47ed9e0f379 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:29.435707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85c165a9-0bcc-4d3b-86fa-c47ed9e0f379 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:29.436469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85c165a9-0bcc-4d3b-86fa-c47ed9e0f379 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:29.436897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85c165a9-0bcc-4d3b-86fa-c47ed9e0f379 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:29.465656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-85c165a9-0bcc-4d3b-86fa-c47ed9e0f379 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041089 Nov 08 17:49:29.466199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 898/1816] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:30.477273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2cc64e46-0194-42f2-9bb3-acb11b56d415 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:30.478193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2cc64e46-0194-42f2-9bb3-acb11b56d415 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:30.488300 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2cc64e46-0194-42f2-9bb3-acb11b56d415 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:30.488742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2cc64e46-0194-42f2-9bb3-acb11b56d415 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:30.489516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2cc64e46-0194-42f2-9bb3-acb11b56d415 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:30.489944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2cc64e46-0194-42f2-9bb3-acb11b56d415 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:30.519246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2cc64e46-0194-42f2-9bb3-acb11b56d415 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Nov 08 17:49:30.519796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 919/1817] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:31.529900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f0e41540-9c9e-4723-8c62-3b31ab776d07 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:31.530839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f0e41540-9c9e-4723-8c62-3b31ab776d07 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:31.537686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0e41540-9c9e-4723-8c62-3b31ab776d07 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:31.538135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0e41540-9c9e-4723-8c62-3b31ab776d07 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:31.538926 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0e41540-9c9e-4723-8c62-3b31ab776d07 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:31.539367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f0e41540-9c9e-4723-8c62-3b31ab776d07 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:31.566969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f0e41540-9c9e-4723-8c62-3b31ab776d07 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040800 Nov 08 17:49:31.567514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 899/1818] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:32.577674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-40e6aff1-2029-4631-b9a6-c90c2bc319fb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:49:32.578729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-40e6aff1-2029-4631-b9a6-c90c2bc319fb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:32.584925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40e6aff1-2029-4631-b9a6-c90c2bc319fb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:32.585376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40e6aff1-2029-4631-b9a6-c90c2bc319fb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:32.586151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40e6aff1-2029-4631-b9a6-c90c2bc319fb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:32.586623 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40e6aff1-2029-4631-b9a6-c90c2bc319fb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:32.615779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-40e6aff1-2029-4631-b9a6-c90c2bc319fb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 Nov 08 17:49:32.616327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 920/1819] 10.222.0.18 () {58 vars in 1301 bytes} [Mon Nov 8 17:49:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:49:33.626591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f2d05ca8-de9c-4404-a7c7-9f469435652f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:49:33.627610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f2d05ca8-de9c-4404-a7c7-9f469435652f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:49:33.633705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f2d05ca8-de9c-4404-a7c7-9f469435652f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:33.634145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f2d05ca8-de9c-4404-a7c7-9f469435652f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:33.634939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f2d05ca8-de9c-4404-a7c7-9f469435652f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:49:33.635363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f2d05ca8-de9c-4404-a7c7-9f469435652f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:49:33.718398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f2d05ca8-de9c-4404-a7c7-9f469435652f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action" status: 200 len: 104100 microversion: 2.1 time: 0.095921 Nov 08 17:49:33.719214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 900/1820] 10.222.0.18 () {60 vars in 1277 bytes} [Mon Nov 8 17:49:33 2021] POST /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194/action => generated 104100 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:49:52.258120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:49:52.258811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:49:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:50:08.119339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e8e879ab-36f3-4c70-82b1-7b7ecdd43a8c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:50:08.119853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e8e879ab-36f3-4c70-82b1-7b7ecdd43a8c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:50:08.125542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e8e879ab-36f3-4c70-82b1-7b7ecdd43a8c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:08.125976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e8e879ab-36f3-4c70-82b1-7b7ecdd43a8c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:08.126766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e8e879ab-36f3-4c70-82b1-7b7ecdd43a8c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:08.127192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e8e879ab-36f3-4c70-82b1-7b7ecdd43a8c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:08.151596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e8e879ab-36f3-4c70-82b1-7b7ecdd43a8c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:50:08.484874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e8e879ab-36f3-4c70-82b1-7b7ecdd43a8c tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 204 len: 0 microversion: 2.1 time: 0.368663 Nov 08 17:50:08.485658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 921/1821] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:50:08 2021] DELETE /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:50:08.493920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-44b98dbd-404e-49bb-ac4c-b0f875ed3665 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:50:08.494649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-44b98dbd-404e-49bb-ac4c-b0f875ed3665 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:50:08.501973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44b98dbd-404e-49bb-ac4c-b0f875ed3665 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:08.502398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44b98dbd-404e-49bb-ac4c-b0f875ed3665 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:08.503207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44b98dbd-404e-49bb-ac4c-b0f875ed3665 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:08.503639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44b98dbd-404e-49bb-ac4c-b0f875ed3665 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:08.744232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-44b98dbd-404e-49bb-ac4c-b0f875ed3665 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:50:08.752022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-44b98dbd-404e-49bb-ac4c-b0f875ed3665 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1672 microversion: 2.1 time: 0.262070 Nov 08 17:50:08.752594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 901/1822] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:50:08 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1672 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:50:09.770700 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1532c950-fa09-4d91-8857-3b5043a9285e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:50:09.771510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1532c950-fa09-4d91-8857-3b5043a9285e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:50:09.780771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1532c950-fa09-4d91-8857-3b5043a9285e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:09.781271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1532c950-fa09-4d91-8857-3b5043a9285e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:09.783334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1532c950-fa09-4d91-8857-3b5043a9285e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:09.783969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1532c950-fa09-4d91-8857-3b5043a9285e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:09.896320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-d53eb3d7-4f42-4792-ba49-26cc2e382dbd req-285c509c-f6be-4d93-a655-c3c02205c857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a296b-b0ac-4115-a9a2-f536ff671fea", "name": "network-vif-deleted", "tag": "4ad212cb-fb00-4b9c-a3e0-700699dcc819"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:50:09.896320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:50:09.896320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:50:09.912653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-d53eb3d7-4f42-4792-ba49-26cc2e382dbd req-285c509c-f6be-4d93-a655-c3c02205c857 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:09.913084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-d53eb3d7-4f42-4792-ba49-26cc2e382dbd req-285c509c-f6be-4d93-a655-c3c02205c857 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:09.925565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-d53eb3d7-4f42-4792-ba49-26cc2e382dbd req-285c509c-f6be-4d93-a655-c3c02205c857 service nova] Creating event network-vif-deleted:4ad212cb-fb00-4b9c-a3e0-700699dcc819 for instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea on hv-cinder-81689 Nov 08 17:50:09.931536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-d53eb3d7-4f42-4792-ba49-26cc2e382dbd req-285c509c-f6be-4d93-a655-c3c02205c857 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121356 Nov 08 17:50:09.932633 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 902/1823] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:50:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 17:50:09.945881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1532c950-fa09-4d91-8857-3b5043a9285e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38b562a5b8db48508f2b712487d4ca4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf7369a158d465290a1686f76514638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:50:09.954848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1532c950-fa09-4d91-8857-3b5043a9285e tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 200 len: 1606 microversion: 2.1 time: 0.188473 Nov 08 17:50:09.956016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 922/1824] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:50:09 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 1606 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:50:10.973622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:50:10.974221 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:50:10.981418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:10.982226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:10.983049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:50:10.983482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:50:10.999687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] HTTP exception thrown: Instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea could not be found. Nov 08 17:50:11.000277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Returning 404 to user: Instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:50:11.001099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1ebcdc95-27c3-43bb-b0bd-f3d18f04fe68 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 404 len: 111 microversion: 2.1 time: 0.032269 Nov 08 17:50:11.001641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 903/1825] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:50:10 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:50:11.009773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-22bf55f7-0f26-4df1-a637-9861f7f87744 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '.version_select at 0x7f06ec3c3f70>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:50:11.095131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-22bf55f7-0f26-4df1-a637-9861f7f87744 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832262475" status: 202 len: 0 microversion: 2.1 time: 0.088881 Nov 08 17:50:11.095726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 923/1826] 10.222.0.18 () {58 vars in 1220 bytes} [Mon Nov 8 17:50:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832262475 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 08 17:50:29.471664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:50:29.472354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 17:50:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:52:10.458841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:52:10.459347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:52:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:52:45.954665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:52:45.955274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:52:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:53:12.276138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:53:12.276778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:53:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:53:49.489499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:53:49.490233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 17:53:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:54:11.370009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3774545c-b517-444a-b51c-8a639ea5b12f] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 08 17:54:11.373418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f62858fa-eeae-49da-a2d5-1dfc6e992cef tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:11.373914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f62858fa-eeae-49da-a2d5-1dfc6e992cef tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:11.380387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f62858fa-eeae-49da-a2d5-1dfc6e992cef tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:11.380817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f62858fa-eeae-49da-a2d5-1dfc6e992cef tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:11.382400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f62858fa-eeae-49da-a2d5-1dfc6e992cef tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:11.382615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f62858fa-eeae-49da-a2d5-1dfc6e992cef tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:11.406395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f62858fa-eeae-49da-a2d5-1dfc6e992cef tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Going to try to terminate instance {{(pid=127763) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:54:11.629224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f62858fa-eeae-49da-a2d5-1dfc6e992cef tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 204 len: 0 microversion: 2.1 time: 0.260933 Nov 08 17:54:11.629889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 904/1827] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:54:11 2021] DELETE /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 17:54:11.637258 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3ffaa8fd-e4fd-4972-bee0-755ece7c68e0] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 08 17:54:11.640954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-19952822-d5a8-4528-b6c8-b4cce8946a84 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:11.641569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-19952822-d5a8-4528-b6c8-b4cce8946a84 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:11.649166 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19952822-d5a8-4528-b6c8-b4cce8946a84 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:11.649619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19952822-d5a8-4528-b6c8-b4cce8946a84 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:11.650400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19952822-d5a8-4528-b6c8-b4cce8946a84 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:11.650868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19952822-d5a8-4528-b6c8-b4cce8946a84 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:11.779851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-19952822-d5a8-4528-b6c8-b4cce8946a84 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:11.787600 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-19952822-d5a8-4528-b6c8-b4cce8946a84 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152867 Nov 08 17:54:11.788192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 924/1828] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:11 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:12.804536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-75e71455-efd9-4cc6-9bce-9582b28084b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:12.805265 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-75e71455-efd9-4cc6-9bce-9582b28084b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:12.822501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75e71455-efd9-4cc6-9bce-9582b28084b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:12.822899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75e71455-efd9-4cc6-9bce-9582b28084b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:12.823674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75e71455-efd9-4cc6-9bce-9582b28084b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:12.824109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75e71455-efd9-4cc6-9bce-9582b28084b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:12.829126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] [3774545c-b517-444a-b51c-8a639ea5b12f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54200. Nov 08 17:54:12.956078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-75e71455-efd9-4cc6-9bce-9582b28084b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:12.964712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-75e71455-efd9-4cc6-9bce-9582b28084b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.164359 Nov 08 17:54:12.965272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 905/1829] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:12 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:13.982609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-685b0a6f-9174-4a6b-8284-ae655d5e8ca9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:13.983156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-685b0a6f-9174-4a6b-8284-ae655d5e8ca9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:13.999818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-685b0a6f-9174-4a6b-8284-ae655d5e8ca9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:14.000291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-685b0a6f-9174-4a6b-8284-ae655d5e8ca9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:14.001064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-685b0a6f-9174-4a6b-8284-ae655d5e8ca9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:14.001495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-685b0a6f-9174-4a6b-8284-ae655d5e8ca9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:14.016914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] [3ffaa8fd-e4fd-4972-bee0-755ece7c68e0] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54212. Nov 08 17:54:14.132729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-685b0a6f-9174-4a6b-8284-ae655d5e8ca9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:14.140654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-685b0a6f-9174-4a6b-8284-ae655d5e8ca9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.162105 Nov 08 17:54:14.141209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 925/1830] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:13 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:15.157951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9a151ad0-df48-4833-9797-1275a59d04ba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:15.158697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9a151ad0-df48-4833-9797-1275a59d04ba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:15.165343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a151ad0-df48-4833-9797-1275a59d04ba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:15.165710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a151ad0-df48-4833-9797-1275a59d04ba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:15.166529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a151ad0-df48-4833-9797-1275a59d04ba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:15.166954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a151ad0-df48-4833-9797-1275a59d04ba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:15.293682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9a151ad0-df48-4833-9797-1275a59d04ba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:15.301295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9a151ad0-df48-4833-9797-1275a59d04ba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147428 Nov 08 17:54:15.301849 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 906/1831] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:15 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:16.318663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a92a80d5-0ef1-4f10-a22e-7e4c656ef7c1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:16.319848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a92a80d5-0ef1-4f10-a22e-7e4c656ef7c1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:16.326043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a92a80d5-0ef1-4f10-a22e-7e4c656ef7c1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:16.326506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a92a80d5-0ef1-4f10-a22e-7e4c656ef7c1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:16.327277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a92a80d5-0ef1-4f10-a22e-7e4c656ef7c1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:16.327709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a92a80d5-0ef1-4f10-a22e-7e4c656ef7c1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:16.457221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a92a80d5-0ef1-4f10-a22e-7e4c656ef7c1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:16.464997 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a92a80d5-0ef1-4f10-a22e-7e4c656ef7c1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150115 Nov 08 17:54:16.465551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 926/1832] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:16 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:17.481176 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-37aa678f-411a-4717-a3d4-6b5c9261e750 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:17.481811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-37aa678f-411a-4717-a3d4-6b5c9261e750 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:17.487986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-37aa678f-411a-4717-a3d4-6b5c9261e750 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:17.488429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-37aa678f-411a-4717-a3d4-6b5c9261e750 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:17.489193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-37aa678f-411a-4717-a3d4-6b5c9261e750 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:17.489623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-37aa678f-411a-4717-a3d4-6b5c9261e750 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:17.625352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-37aa678f-411a-4717-a3d4-6b5c9261e750 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:17.634018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-37aa678f-411a-4717-a3d4-6b5c9261e750 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.156732 Nov 08 17:54:17.634741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 907/1833] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:17 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:18.651094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-14006be1-89f0-46b2-a8ad-a341af2249e6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:18.651703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-14006be1-89f0-46b2-a8ad-a341af2249e6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:18.657857 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14006be1-89f0-46b2-a8ad-a341af2249e6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:18.658297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14006be1-89f0-46b2-a8ad-a341af2249e6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:18.659104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14006be1-89f0-46b2-a8ad-a341af2249e6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:18.660975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14006be1-89f0-46b2-a8ad-a341af2249e6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:18.837119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-14006be1-89f0-46b2-a8ad-a341af2249e6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:18.844847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-14006be1-89f0-46b2-a8ad-a341af2249e6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.197768 Nov 08 17:54:18.845430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 927/1834] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:18 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:19.861913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e467236b-cea7-434e-b632-2550b3b40d39 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:19.862540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e467236b-cea7-434e-b632-2550b3b40d39 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:19.869480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e467236b-cea7-434e-b632-2550b3b40d39 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:19.869921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e467236b-cea7-434e-b632-2550b3b40d39 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:19.870715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e467236b-cea7-434e-b632-2550b3b40d39 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:19.871144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e467236b-cea7-434e-b632-2550b3b40d39 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:20.006848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e467236b-cea7-434e-b632-2550b3b40d39 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:20.018806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e467236b-cea7-434e-b632-2550b3b40d39 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.160445 Nov 08 17:54:20.021507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 908/1835] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:19 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:21.037061 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d95b0095-a7f3-43c1-be10-3b4dedf5f6fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:21.037674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d95b0095-a7f3-43c1-be10-3b4dedf5f6fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:21.044274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d95b0095-a7f3-43c1-be10-3b4dedf5f6fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:21.044716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d95b0095-a7f3-43c1-be10-3b4dedf5f6fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:21.045491 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d95b0095-a7f3-43c1-be10-3b4dedf5f6fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:21.045919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d95b0095-a7f3-43c1-be10-3b4dedf5f6fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:21.175872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d95b0095-a7f3-43c1-be10-3b4dedf5f6fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:21.184451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d95b0095-a7f3-43c1-be10-3b4dedf5f6fe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151452 Nov 08 17:54:21.185008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 928/1836] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:21 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:22.201598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ec262587-88a8-4de5-a954-cf31050c3145 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:22.202291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ec262587-88a8-4de5-a954-cf31050c3145 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:22.208594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec262587-88a8-4de5-a954-cf31050c3145 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:22.209033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec262587-88a8-4de5-a954-cf31050c3145 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:22.209796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec262587-88a8-4de5-a954-cf31050c3145 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:22.210224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec262587-88a8-4de5-a954-cf31050c3145 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:22.343496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ec262587-88a8-4de5-a954-cf31050c3145 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:22.351388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ec262587-88a8-4de5-a954-cf31050c3145 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153373 Nov 08 17:54:22.352668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 909/1837] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:22 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:23.369625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6fbb5dfd-c428-4a3d-b6ef-95f4747c3489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:23.370268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6fbb5dfd-c428-4a3d-b6ef-95f4747c3489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:23.376671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6fbb5dfd-c428-4a3d-b6ef-95f4747c3489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:23.377121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6fbb5dfd-c428-4a3d-b6ef-95f4747c3489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:23.377899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6fbb5dfd-c428-4a3d-b6ef-95f4747c3489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:23.378337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6fbb5dfd-c428-4a3d-b6ef-95f4747c3489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:23.508650 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6fbb5dfd-c428-4a3d-b6ef-95f4747c3489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:23.516361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6fbb5dfd-c428-4a3d-b6ef-95f4747c3489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151388 Nov 08 17:54:23.516924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 929/1838] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:23 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:24.532490 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-590f6a70-f023-4577-8572-cfc20ed84ec2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:24.533133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-590f6a70-f023-4577-8572-cfc20ed84ec2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:24.539618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-590f6a70-f023-4577-8572-cfc20ed84ec2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:24.540062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-590f6a70-f023-4577-8572-cfc20ed84ec2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:24.540838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-590f6a70-f023-4577-8572-cfc20ed84ec2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:24.541263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-590f6a70-f023-4577-8572-cfc20ed84ec2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:24.678634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-590f6a70-f023-4577-8572-cfc20ed84ec2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:24.686607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-590f6a70-f023-4577-8572-cfc20ed84ec2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.157706 Nov 08 17:54:24.687181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 910/1839] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:24 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:25.703710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-868bbf75-b293-41fc-8497-efccf511eb23 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:25.704384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-868bbf75-b293-41fc-8497-efccf511eb23 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:25.713310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-868bbf75-b293-41fc-8497-efccf511eb23 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:25.713310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-868bbf75-b293-41fc-8497-efccf511eb23 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:25.713310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-868bbf75-b293-41fc-8497-efccf511eb23 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:25.713836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-868bbf75-b293-41fc-8497-efccf511eb23 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:25.849566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-868bbf75-b293-41fc-8497-efccf511eb23 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:25.857761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-868bbf75-b293-41fc-8497-efccf511eb23 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.157679 Nov 08 17:54:25.858330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 930/1840] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:25 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:26.876626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-16964ad6-2d6c-4ab9-ae2d-d588c95b330b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:26.878188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-16964ad6-2d6c-4ab9-ae2d-d588c95b330b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:26.886407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16964ad6-2d6c-4ab9-ae2d-d588c95b330b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:26.886680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16964ad6-2d6c-4ab9-ae2d-d588c95b330b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:26.887811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16964ad6-2d6c-4ab9-ae2d-d588c95b330b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:26.888401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16964ad6-2d6c-4ab9-ae2d-d588c95b330b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:27.051088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-16964ad6-2d6c-4ab9-ae2d-d588c95b330b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:27.066389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-16964ad6-2d6c-4ab9-ae2d-d588c95b330b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.195574 Nov 08 17:54:27.067018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 911/1841] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:26 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:28.084669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e5532012-7c1e-4c66-9678-8a4f46715f02 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:28.085284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e5532012-7c1e-4c66-9678-8a4f46715f02 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:28.091563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5532012-7c1e-4c66-9678-8a4f46715f02 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:28.092013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5532012-7c1e-4c66-9678-8a4f46715f02 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:28.092793 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5532012-7c1e-4c66-9678-8a4f46715f02 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:28.093226 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5532012-7c1e-4c66-9678-8a4f46715f02 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:28.232519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e5532012-7c1e-4c66-9678-8a4f46715f02 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:28.240632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e5532012-7c1e-4c66-9678-8a4f46715f02 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.160534 Nov 08 17:54:28.241343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 931/1842] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:28 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:29.259038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a85b45f3-c2ed-448f-b742-07b3891bbfa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:29.259770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a85b45f3-c2ed-448f-b742-07b3891bbfa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:29.266187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a85b45f3-c2ed-448f-b742-07b3891bbfa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:29.266706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a85b45f3-c2ed-448f-b742-07b3891bbfa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:29.267558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a85b45f3-c2ed-448f-b742-07b3891bbfa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:29.267988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a85b45f3-c2ed-448f-b742-07b3891bbfa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:29.425861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a85b45f3-c2ed-448f-b742-07b3891bbfa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:29.436852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a85b45f3-c2ed-448f-b742-07b3891bbfa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.182158 Nov 08 17:54:29.437783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 912/1843] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:29 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:30.453907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-56b54b26-0476-484e-99c3-7ba309f5fd88 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:30.454603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-56b54b26-0476-484e-99c3-7ba309f5fd88 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:30.460806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56b54b26-0476-484e-99c3-7ba309f5fd88 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:30.461789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56b54b26-0476-484e-99c3-7ba309f5fd88 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:30.462974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56b54b26-0476-484e-99c3-7ba309f5fd88 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:30.463416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56b54b26-0476-484e-99c3-7ba309f5fd88 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:30.621443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-56b54b26-0476-484e-99c3-7ba309f5fd88 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:30.629260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-56b54b26-0476-484e-99c3-7ba309f5fd88 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.179034 Nov 08 17:54:30.629830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 932/1844] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:30 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:31.652989 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c691658f-8752-4177-b1c4-d33999912585 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:31.653634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c691658f-8752-4177-b1c4-d33999912585 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:31.660694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c691658f-8752-4177-b1c4-d33999912585 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:31.661143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c691658f-8752-4177-b1c4-d33999912585 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:31.662233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c691658f-8752-4177-b1c4-d33999912585 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:31.663004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c691658f-8752-4177-b1c4-d33999912585 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:31.820526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c691658f-8752-4177-b1c4-d33999912585 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:31.823309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c691658f-8752-4177-b1c4-d33999912585 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.174664 Nov 08 17:54:31.824010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 913/1845] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:31 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:32.842195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-95cfcb3f-f460-4f59-9e78-cd4e1341cb9a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:32.843837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-95cfcb3f-f460-4f59-9e78-cd4e1341cb9a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:32.854403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95cfcb3f-f460-4f59-9e78-cd4e1341cb9a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:32.855732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95cfcb3f-f460-4f59-9e78-cd4e1341cb9a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:32.856817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95cfcb3f-f460-4f59-9e78-cd4e1341cb9a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:32.857551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95cfcb3f-f460-4f59-9e78-cd4e1341cb9a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:33.043099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95cfcb3f-f460-4f59-9e78-cd4e1341cb9a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:33.052093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-95cfcb3f-f460-4f59-9e78-cd4e1341cb9a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.214451 Nov 08 17:54:33.062413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 933/1846] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:32 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:34.069151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f5b0202-04cb-4b94-ad86-c5a3d24e129f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:34.069757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5f5b0202-04cb-4b94-ad86-c5a3d24e129f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:34.080048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f5b0202-04cb-4b94-ad86-c5a3d24e129f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:34.080497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f5b0202-04cb-4b94-ad86-c5a3d24e129f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:34.081285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f5b0202-04cb-4b94-ad86-c5a3d24e129f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:34.083119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f5b0202-04cb-4b94-ad86-c5a3d24e129f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:34.302329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5f5b0202-04cb-4b94-ad86-c5a3d24e129f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:34.315807 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5f5b0202-04cb-4b94-ad86-c5a3d24e129f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.250319 Nov 08 17:54:34.317708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 914/1847] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:34 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:35.349118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-25139258-c4f5-45b2-b533-e1210e34e46b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:35.359667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-25139258-c4f5-45b2-b533-e1210e34e46b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:35.377428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-25139258-c4f5-45b2-b533-e1210e34e46b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:35.379056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-25139258-c4f5-45b2-b533-e1210e34e46b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:35.381218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-25139258-c4f5-45b2-b533-e1210e34e46b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:35.381678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-25139258-c4f5-45b2-b533-e1210e34e46b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:35.527779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-25139258-c4f5-45b2-b533-e1210e34e46b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:35.536840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-25139258-c4f5-45b2-b533-e1210e34e46b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.205755 Nov 08 17:54:35.537413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 934/1848] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:35 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:36.554411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-385ee148-76bd-40ac-80bc-0ac1b85880c8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:36.555082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-385ee148-76bd-40ac-80bc-0ac1b85880c8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:36.561343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-385ee148-76bd-40ac-80bc-0ac1b85880c8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:36.561791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-385ee148-76bd-40ac-80bc-0ac1b85880c8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:36.562645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-385ee148-76bd-40ac-80bc-0ac1b85880c8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:36.563082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-385ee148-76bd-40ac-80bc-0ac1b85880c8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:36.698531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-385ee148-76bd-40ac-80bc-0ac1b85880c8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:36.706563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-385ee148-76bd-40ac-80bc-0ac1b85880c8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155720 Nov 08 17:54:36.707435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 915/1849] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:36 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:37.724351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f3bb006e-c6ef-4c2f-a419-87b1b8f1f334 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:37.724937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f3bb006e-c6ef-4c2f-a419-87b1b8f1f334 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:37.732566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3bb006e-c6ef-4c2f-a419-87b1b8f1f334 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:37.733248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3bb006e-c6ef-4c2f-a419-87b1b8f1f334 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:37.734247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3bb006e-c6ef-4c2f-a419-87b1b8f1f334 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:37.735176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f3bb006e-c6ef-4c2f-a419-87b1b8f1f334 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:37.903409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f3bb006e-c6ef-4c2f-a419-87b1b8f1f334 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:37.918896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f3bb006e-c6ef-4c2f-a419-87b1b8f1f334 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.197989 Nov 08 17:54:37.919498 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 935/1850] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:37 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:38.936868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b8804bd0-181d-4209-9a17-9415cedb1e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:38.937663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b8804bd0-181d-4209-9a17-9415cedb1e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:38.945116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b8804bd0-181d-4209-9a17-9415cedb1e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:38.946427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b8804bd0-181d-4209-9a17-9415cedb1e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:38.947367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b8804bd0-181d-4209-9a17-9415cedb1e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:38.947799 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b8804bd0-181d-4209-9a17-9415cedb1e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:39.173684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b8804bd0-181d-4209-9a17-9415cedb1e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:39.181690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b8804bd0-181d-4209-9a17-9415cedb1e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.249009 Nov 08 17:54:39.182827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 916/1851] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:38 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:40.205996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5d4df4af-c013-4b2d-b7f8-be954ebf6c92 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:40.206648 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5d4df4af-c013-4b2d-b7f8-be954ebf6c92 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:40.212654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5d4df4af-c013-4b2d-b7f8-be954ebf6c92 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:40.213169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5d4df4af-c013-4b2d-b7f8-be954ebf6c92 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:40.213893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5d4df4af-c013-4b2d-b7f8-be954ebf6c92 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:40.214333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5d4df4af-c013-4b2d-b7f8-be954ebf6c92 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:40.350018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5d4df4af-c013-4b2d-b7f8-be954ebf6c92 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:40.358625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5d4df4af-c013-4b2d-b7f8-be954ebf6c92 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.163830 Nov 08 17:54:40.359211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 936/1852] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:40 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:41.378658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e1feadd9-b2fa-4968-a1ab-ec898606c05d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:41.386380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e1feadd9-b2fa-4968-a1ab-ec898606c05d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:41.392944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1feadd9-b2fa-4968-a1ab-ec898606c05d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:41.393598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1feadd9-b2fa-4968-a1ab-ec898606c05d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:41.394378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1feadd9-b2fa-4968-a1ab-ec898606c05d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:41.394852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1feadd9-b2fa-4968-a1ab-ec898606c05d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:41.543714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e1feadd9-b2fa-4968-a1ab-ec898606c05d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:41.553431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e1feadd9-b2fa-4968-a1ab-ec898606c05d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.180958 Nov 08 17:54:41.555144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 917/1853] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:41 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:42.571357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-60fad216-3368-436d-8a0d-1dc3fca98afb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:42.572754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-60fad216-3368-436d-8a0d-1dc3fca98afb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:42.580066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60fad216-3368-436d-8a0d-1dc3fca98afb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:42.580515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60fad216-3368-436d-8a0d-1dc3fca98afb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:42.581295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60fad216-3368-436d-8a0d-1dc3fca98afb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:42.581728 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60fad216-3368-436d-8a0d-1dc3fca98afb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:42.744911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-60fad216-3368-436d-8a0d-1dc3fca98afb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:42.754015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-60fad216-3368-436d-8a0d-1dc3fca98afb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.187073 Nov 08 17:54:42.755177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 937/1854] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:42 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:43.773047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8b43f9ec-a148-48a3-bf9d-219f91bb876f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:43.775004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8b43f9ec-a148-48a3-bf9d-219f91bb876f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:43.781844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8b43f9ec-a148-48a3-bf9d-219f91bb876f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:43.782573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8b43f9ec-a148-48a3-bf9d-219f91bb876f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:43.783674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8b43f9ec-a148-48a3-bf9d-219f91bb876f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:43.784293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8b43f9ec-a148-48a3-bf9d-219f91bb876f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:43.928558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8b43f9ec-a148-48a3-bf9d-219f91bb876f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:43.937359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8b43f9ec-a148-48a3-bf9d-219f91bb876f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.169922 Nov 08 17:54:43.937909 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 918/1855] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:43 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:44.955101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fb5e91f2-c891-4469-8213-6693ba9ca4ad tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:44.955848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fb5e91f2-c891-4469-8213-6693ba9ca4ad tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:44.962192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb5e91f2-c891-4469-8213-6693ba9ca4ad tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:44.962958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb5e91f2-c891-4469-8213-6693ba9ca4ad tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:44.963459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb5e91f2-c891-4469-8213-6693ba9ca4ad tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:44.963885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb5e91f2-c891-4469-8213-6693ba9ca4ad tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:45.109643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fb5e91f2-c891-4469-8213-6693ba9ca4ad tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:45.118118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fb5e91f2-c891-4469-8213-6693ba9ca4ad tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.166879 Nov 08 17:54:45.118733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 938/1856] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:44 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:46.135775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-abb872d0-81b8-43d8-a39e-71163e164d2d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:46.136345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-abb872d0-81b8-43d8-a39e-71163e164d2d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:46.143055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-abb872d0-81b8-43d8-a39e-71163e164d2d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:46.143497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-abb872d0-81b8-43d8-a39e-71163e164d2d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:46.144301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-abb872d0-81b8-43d8-a39e-71163e164d2d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:46.144728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-abb872d0-81b8-43d8-a39e-71163e164d2d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:46.295239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-abb872d0-81b8-43d8-a39e-71163e164d2d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:46.303120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-abb872d0-81b8-43d8-a39e-71163e164d2d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.171789 Nov 08 17:54:46.303685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 919/1857] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:46 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:47.323613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6646705f-2e9b-4383-a253-ed002fdfc3a4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:47.324218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6646705f-2e9b-4383-a253-ed002fdfc3a4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:47.330612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6646705f-2e9b-4383-a253-ed002fdfc3a4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:47.331060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6646705f-2e9b-4383-a253-ed002fdfc3a4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:47.331831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6646705f-2e9b-4383-a253-ed002fdfc3a4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:47.332263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6646705f-2e9b-4383-a253-ed002fdfc3a4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:47.464902 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6646705f-2e9b-4383-a253-ed002fdfc3a4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:47.472734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6646705f-2e9b-4383-a253-ed002fdfc3a4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153370 Nov 08 17:54:47.473488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 939/1858] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:47 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:47.595835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-062b0a7b-d634-4d15-b892-321e439cf9eb tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Action: 'create', calling method: .version_select at 0x7f06ec2eaca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-856997796"}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:54:47.609809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-062b0a7b-d634-4d15-b892-321e439cf9eb tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Getting quotas for project 5ace5aeb13f14cd4a8df4694a033b9e7. Resources: {'key_pairs'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:54:47.613544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-062b0a7b-d634-4d15-b892-321e439cf9eb tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Getting quotas for user d81b2d96645d409a8ee24c22b0a38212 and project 5ace5aeb13f14cd4a8df4694a033b9e7. Resources: {'key_pairs'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:54:47.878225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-062b0a7b-d634-4d15-b892-321e439cf9eb tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Getting quotas for project 5ace5aeb13f14cd4a8df4694a033b9e7. Resources: {'key_pairs'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:54:47.881856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-062b0a7b-d634-4d15-b892-321e439cf9eb tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Getting quotas for user d81b2d96645d409a8ee24c22b0a38212 and project 5ace5aeb13f14cd4a8df4694a033b9e7. Resources: {'key_pairs'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:54:47.894287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-062b0a7b-d634-4d15-b892-321e439cf9eb tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.302042 Nov 08 17:54:47.895056 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 920/1859] 10.222.0.18 () {60 vars in 1157 bytes} [Mon Nov 8 17:54:47 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:47.941766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-658509208", "imageRef": "0e3d3dc2-392d-4daf-a522-277493765ee3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-856997796", "networks": [{"uuid": "1ef3dcf3-cb9c-4558-8980-e4d264e405a3"}]}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:54:47.993121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.network.neutron [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] validate_networks() for [('1ef3dcf3-cb9c-4558-8980-e4d264e405a3', None, None, None, None, None)] {{(pid=127762) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 17:54:48.446210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Flavor limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 17:54:48.446769 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Image limits 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 17:54:48.447132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Flavor pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 17:54:48.447536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Image pref 0:0:0 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 17:54:48.447939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.virt.hardware [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 17:54:48.458948 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:48.459389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:48.460188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:48.461581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:48.478023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Getting quotas for project 5ace5aeb13f14cd4a8df4694a033b9e7. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:54:48.482131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Getting quotas for user d81b2d96645d409a8ee24c22b0a38212 and project 5ace5aeb13f14cd4a8df4694a033b9e7. Resources: {'ram', 'instances', 'cores'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:54:48.488864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-295df061-e4d3-4474-8473-7076b7c7624e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:48.489471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-295df061-e4d3-4474-8473-7076b7c7624e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:48.492945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Going to run 1 instances... {{(pid=127762) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 17:54:48.495191 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0e3d3dc2-392d-4daf-a522-277493765ee3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 17:54:48.495728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-295df061-e4d3-4474-8473-7076b7c7624e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:48.496177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-295df061-e4d3-4474-8473-7076b7c7624e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:48.496943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-295df061-e4d3-4474-8473-7076b7c7624e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:48.497375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-295df061-e4d3-4474-8473-7076b7c7624e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:48.621264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bf8537a4-db2e-4886-b711-cf16718d27f3 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683077 Nov 08 17:54:48.627490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 940/1860] 10.222.0.18 () {60 vars in 1146 bytes} [Mon Nov 8 17:54:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 08 17:54:48.632910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:48.633599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:48.638190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-295df061-e4d3-4474-8473-7076b7c7624e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:48.644068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:48.644637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:48.645309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:48.645743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:48.647521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-295df061-e4d3-4474-8473-7076b7c7624e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.162342 Nov 08 17:54:48.648706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 921/1861] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:48 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:54:48.653421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7c9de43b-ab66-4285-94f2-0f4cfd625368 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:48.654029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7c9de43b-ab66-4285-94f2-0f4cfd625368 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:48.685186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:54:48.728117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7c9de43b-ab66-4285-94f2-0f4cfd625368 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:48.734811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7c9de43b-ab66-4285-94f2-0f4cfd625368 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1257 microversion: 2.1 time: 0.084657 Nov 08 17:54:48.735405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 922/1862] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:48 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1257 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:48.866169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [8b8a761b-b175-42bc-b483-2d3f163b9e19] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 08 17:54:49.664833 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1f219903-1d1b-47e1-9fb1-9ddc32a8e07b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:49.665430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1f219903-1d1b-47e1-9fb1-9ddc32a8e07b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:49.672230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1f219903-1d1b-47e1-9fb1-9ddc32a8e07b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:49.672670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1f219903-1d1b-47e1-9fb1-9ddc32a8e07b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:49.673428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1f219903-1d1b-47e1-9fb1-9ddc32a8e07b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:49.673853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1f219903-1d1b-47e1-9fb1-9ddc32a8e07b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:49.805781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1f219903-1d1b-47e1-9fb1-9ddc32a8e07b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:49.813499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1f219903-1d1b-47e1-9fb1-9ddc32a8e07b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152368 Nov 08 17:54:49.814051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 923/1863] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:49 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:54:49.818240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7edc64fb-eaea-4614-b931-d332c36b6e2a tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:49.818862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7edc64fb-eaea-4614-b931-d332c36b6e2a tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:49.824922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7edc64fb-eaea-4614-b931-d332c36b6e2a tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:49.825361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7edc64fb-eaea-4614-b931-d332c36b6e2a tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:49.826117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7edc64fb-eaea-4614-b931-d332c36b6e2a tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:49.826572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7edc64fb-eaea-4614-b931-d332c36b6e2a tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:49.885842 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [8b8a761b-b175-42bc-b483-2d3f163b9e19] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54716. Nov 08 17:54:49.887157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7edc64fb-eaea-4614-b931-d332c36b6e2a tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:49.894932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7edc64fb-eaea-4614-b931-d332c36b6e2a tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1261 microversion: 2.1 time: 0.079721 Nov 08 17:54:49.896208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 924/1864] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:49 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:49.988652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7965e587-51ff-433e-b405-38c13695d56e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 204 len: 0 microversion: 2.20 time: 1.359922 Nov 08 17:54:49.989243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 941/1865] 10.222.0.18 () {60 vars in 1279 bytes} [Mon Nov 8 17:54:48 2021] DELETE /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 0 bytes in 1361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 08 17:54:49.997721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:49.998340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:50.004211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:50.004645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:50.005407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:50.005829 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:50.143769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:50.151942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:50.153410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:50.154577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d6c34000-913d-4aad-86e4-578874c264de tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1799 microversion: 2.20 time: 0.160442 Nov 08 17:54:50.155126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 925/1866] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1799 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:54:50.830925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3ab55a9e-b6a7-4801-a114-41d37a7e6486 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:50.831725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3ab55a9e-b6a7-4801-a114-41d37a7e6486 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:50.838723 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ab55a9e-b6a7-4801-a114-41d37a7e6486 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:50.839171 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ab55a9e-b6a7-4801-a114-41d37a7e6486 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:50.839948 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ab55a9e-b6a7-4801-a114-41d37a7e6486 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:50.840383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ab55a9e-b6a7-4801-a114-41d37a7e6486 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:50.913248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b9030c21-7545-48d7-8cb2-37bb2dcb6553 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:50.914722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b9030c21-7545-48d7-8cb2-37bb2dcb6553 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:50.921733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9030c21-7545-48d7-8cb2-37bb2dcb6553 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:50.922260 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9030c21-7545-48d7-8cb2-37bb2dcb6553 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:50.923294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9030c21-7545-48d7-8cb2-37bb2dcb6553 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:50.923788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9030c21-7545-48d7-8cb2-37bb2dcb6553 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:51.015361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b9030c21-7545-48d7-8cb2-37bb2dcb6553 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:51.044610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b9030c21-7545-48d7-8cb2-37bb2dcb6553 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1317 microversion: 2.1 time: 0.135123 Nov 08 17:54:51.048599 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 926/1867] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:50 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:54:51.173333 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:51.173936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:51.180714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:51.181409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:51.182193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:51.182647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:51.185480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3ab55a9e-b6a7-4801-a114-41d37a7e6486 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:51.194082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3ab55a9e-b6a7-4801-a114-41d37a7e6486 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.367209 Nov 08 17:54:51.196833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 942/1868] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:50 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:54:51.407808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:51.418969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:51.420909 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:51.422178 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3e72bf55-e6aa-400c-80ee-c5bd6901d95b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1799 microversion: 2.20 time: 0.252637 Nov 08 17:54:51.423107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 927/1869] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1799 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:54:51.657922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-e1163419-84be-4924-aaa2-2762df503041 req-45babcf4-50b1-4269-982e-82bee3eab279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf21b3ca-51f1-43c5-9b61-78422c205ff1", "name": "network-vif-deleted", "tag": "fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:54:51.659512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:54:51.659512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:54:51.667341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-e1163419-84be-4924-aaa2-2762df503041 req-45babcf4-50b1-4269-982e-82bee3eab279 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:51.667790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-e1163419-84be-4924-aaa2-2762df503041 req-45babcf4-50b1-4269-982e-82bee3eab279 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:51.681167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-e1163419-84be-4924-aaa2-2762df503041 req-45babcf4-50b1-4269-982e-82bee3eab279 service nova] Creating event network-vif-deleted:fbd16e5c-a3ea-4b98-97d7-a0cbdbb32a12 for instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 on hv-cinder-81689 Nov 08 17:54:51.713626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-e1163419-84be-4924-aaa2-2762df503041 req-45babcf4-50b1-4269-982e-82bee3eab279 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054149 Nov 08 17:54:51.718661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 943/1870] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:54:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:54:52.062524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8a33df87-d202-454a-b09a-fb49a77b2e57 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:52.063269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8a33df87-d202-454a-b09a-fb49a77b2e57 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:52.078248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a33df87-d202-454a-b09a-fb49a77b2e57 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:52.079141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a33df87-d202-454a-b09a-fb49a77b2e57 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:52.080487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a33df87-d202-454a-b09a-fb49a77b2e57 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:52.081266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a33df87-d202-454a-b09a-fb49a77b2e57 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:52.215734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5801d75b-930a-48b0-9c89-407422abaf13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:52.217089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5801d75b-930a-48b0-9c89-407422abaf13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:52.241487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5801d75b-930a-48b0-9c89-407422abaf13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:52.245813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5801d75b-930a-48b0-9c89-407422abaf13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:52.247432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5801d75b-930a-48b0-9c89-407422abaf13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:52.248982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5801d75b-930a-48b0-9c89-407422abaf13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:52.344799 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8a33df87-d202-454a-b09a-fb49a77b2e57 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:52.356635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8a33df87-d202-454a-b09a-fb49a77b2e57 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.297772 Nov 08 17:54:52.359855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 928/1871] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:52 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:52.444070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:52.445843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:52.454437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:52.455330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:52.456732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:52.457472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:52.614453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:52.627736 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:52.634534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:52.636184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-36bb8d0a-7e51-4163-b78e-6142a7ff051d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.197939 Nov 08 17:54:52.644044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 929/1872] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:54:52.644857 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5801d75b-930a-48b0-9c89-407422abaf13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:52.658009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5801d75b-930a-48b0-9c89-407422abaf13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.448051 Nov 08 17:54:52.660071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 944/1873] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:52 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:53.380355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9b4b1113-26c6-41c4-bfd5-ec379bac5bd9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:53.380355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9b4b1113-26c6-41c4-bfd5-ec379bac5bd9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:53.383976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b4b1113-26c6-41c4-bfd5-ec379bac5bd9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:53.384408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b4b1113-26c6-41c4-bfd5-ec379bac5bd9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:53.385173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b4b1113-26c6-41c4-bfd5-ec379bac5bd9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:53.385625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b4b1113-26c6-41c4-bfd5-ec379bac5bd9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:53.560939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9b4b1113-26c6-41c4-bfd5-ec379bac5bd9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:53.568860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9b4b1113-26c6-41c4-bfd5-ec379bac5bd9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.195930 Nov 08 17:54:53.569450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 930/1874] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:53 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:53.654444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:53.655919 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:53.664746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:53.665194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:53.670943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:53.671861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:53.708044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-9fdd848c-d8e6-49b9-be93-5e187dda9f55 req-907c2fc2-672d-40a9-8193-9c9f0ace47ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e71a891-29d7-4c17-822f-5d7ffec95227", "tag": "63f51964-3a06-45fc-8853-d2c8cd7884a9"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:54:53.709649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:54:53.709649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:54:53.719290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-9fdd848c-d8e6-49b9-be93-5e187dda9f55 req-907c2fc2-672d-40a9-8193-9c9f0ace47ba service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:53.719733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-9fdd848c-d8e6-49b9-be93-5e187dda9f55 req-907c2fc2-672d-40a9-8193-9c9f0ace47ba service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:53.732040 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-9fdd848c-d8e6-49b9-be93-5e187dda9f55 req-907c2fc2-672d-40a9-8193-9c9f0ace47ba service nova] Creating event network-changed:63f51964-3a06-45fc-8853-d2c8cd7884a9 for instance 3e71a891-29d7-4c17-822f-5d7ffec95227 on hv-cinder-81689 Nov 08 17:54:53.737975 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-9fdd848c-d8e6-49b9-be93-5e187dda9f55 req-907c2fc2-672d-40a9-8193-9c9f0ace47ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255997 Nov 08 17:54:53.739825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 945/1875] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:54:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:54:53.746940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7430b494-1239-4cc1-982b-f6999255404c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:53.747858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7430b494-1239-4cc1-982b-f6999255404c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:53.753120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:53.755268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7430b494-1239-4cc1-982b-f6999255404c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:53.755913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7430b494-1239-4cc1-982b-f6999255404c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:53.758270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7430b494-1239-4cc1-982b-f6999255404c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:53.758939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7430b494-1239-4cc1-982b-f6999255404c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:53.763516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:53.765013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:53.766155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e07846f2-1c8a-4acb-8f92-4b0febeddd07 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.115657 Nov 08 17:54:53.767052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 931/1876] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:54:53.905211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7430b494-1239-4cc1-982b-f6999255404c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:53.912979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7430b494-1239-4cc1-982b-f6999255404c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.171809 Nov 08 17:54:53.914137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 946/1877] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:53 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:54.586192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c3f76cb0-d9da-476e-9805-25bd50b9daa0 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:54.586922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c3f76cb0-d9da-476e-9805-25bd50b9daa0 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:54.593021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c3f76cb0-d9da-476e-9805-25bd50b9daa0 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:54.593463 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c3f76cb0-d9da-476e-9805-25bd50b9daa0 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:54.594231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c3f76cb0-d9da-476e-9805-25bd50b9daa0 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:54.594699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c3f76cb0-d9da-476e-9805-25bd50b9daa0 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:54.732176 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c3f76cb0-d9da-476e-9805-25bd50b9daa0 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:54.740044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c3f76cb0-d9da-476e-9805-25bd50b9daa0 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.158062 Nov 08 17:54:54.740759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 932/1878] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:54 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:54.783932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:54.784634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:54.791951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:54.792471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:54.793323 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:54.793814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:54.860518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:54.869297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:54.870919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:54.872172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-29d7710d-90f5-4c74-9cf7-3243d54ec892 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.091820 Nov 08 17:54:54.873069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 947/1879] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:54:54.931506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2484b8b1-b5e9-4d50-9c75-e7a04f954087 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:54.932165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2484b8b1-b5e9-4d50-9c75-e7a04f954087 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:54.938370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2484b8b1-b5e9-4d50-9c75-e7a04f954087 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:54.938851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2484b8b1-b5e9-4d50-9c75-e7a04f954087 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:54.939648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2484b8b1-b5e9-4d50-9c75-e7a04f954087 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:54.940086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2484b8b1-b5e9-4d50-9c75-e7a04f954087 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:55.082403 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2484b8b1-b5e9-4d50-9c75-e7a04f954087 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:55.092615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2484b8b1-b5e9-4d50-9c75-e7a04f954087 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.165018 Nov 08 17:54:55.093373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 933/1880] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:54 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:54:55.758140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4910cce7-c221-4dde-9f43-75e1e5758ba2 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:55.758961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4910cce7-c221-4dde-9f43-75e1e5758ba2 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:55.765419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4910cce7-c221-4dde-9f43-75e1e5758ba2 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:55.765863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4910cce7-c221-4dde-9f43-75e1e5758ba2 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:55.766677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4910cce7-c221-4dde-9f43-75e1e5758ba2 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:55.767111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4910cce7-c221-4dde-9f43-75e1e5758ba2 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:55.890787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:55.891411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:55.899415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:55.899966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:55.900723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:55.901159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:55.902276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4910cce7-c221-4dde-9f43-75e1e5758ba2 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:55.910880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4910cce7-c221-4dde-9f43-75e1e5758ba2 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.157459 Nov 08 17:54:55.911441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 948/1881] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:55 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:55.963036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:55.973252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:55.974909 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:55.977301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-930e73a5-68fa-4e39-accc-a95bbcfe1d1b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.090214 Nov 08 17:54:55.978092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 934/1882] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:54:56.109317 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2d50ceb6-c536-4a86-8c05-072830542fa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:56.109829 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2d50ceb6-c536-4a86-8c05-072830542fa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:56.115730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2d50ceb6-c536-4a86-8c05-072830542fa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:56.116175 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2d50ceb6-c536-4a86-8c05-072830542fa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:56.117486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2d50ceb6-c536-4a86-8c05-072830542fa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:56.117922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2d50ceb6-c536-4a86-8c05-072830542fa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:56.256391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2d50ceb6-c536-4a86-8c05-072830542fa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:56.265877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2d50ceb6-c536-4a86-8c05-072830542fa9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.160295 Nov 08 17:54:56.266450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 949/1883] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:56 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:56.927688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-333ff004-ad4b-43df-9b46-4d7658f35841 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:56.928373 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-333ff004-ad4b-43df-9b46-4d7658f35841 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:56.935066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-333ff004-ad4b-43df-9b46-4d7658f35841 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:56.935590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-333ff004-ad4b-43df-9b46-4d7658f35841 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:56.936379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-333ff004-ad4b-43df-9b46-4d7658f35841 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:56.936814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-333ff004-ad4b-43df-9b46-4d7658f35841 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:56.996199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:56.996966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:57.004295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:57.004738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:57.005557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:57.005970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:57.099676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:57.111109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:57.112754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:57.113831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6a8570b4-5048-4e7d-a947-ffbc036957a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.122187 Nov 08 17:54:57.114732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 950/1884] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:54:57.128771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-333ff004-ad4b-43df-9b46-4d7658f35841 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:57.137681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-333ff004-ad4b-43df-9b46-4d7658f35841 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.213622 Nov 08 17:54:57.138668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 935/1885] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:56 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:54:57.283910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-663c3406-9d47-406d-977e-0245c073ab01 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:57.284615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-663c3406-9d47-406d-977e-0245c073ab01 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:57.297326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-663c3406-9d47-406d-977e-0245c073ab01 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:57.297816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-663c3406-9d47-406d-977e-0245c073ab01 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:57.298668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-663c3406-9d47-406d-977e-0245c073ab01 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:57.299112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-663c3406-9d47-406d-977e-0245c073ab01 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:57.438270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-663c3406-9d47-406d-977e-0245c073ab01 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:57.447375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-663c3406-9d47-406d-977e-0245c073ab01 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.166938 Nov 08 17:54:57.450774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 951/1886] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:57 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:58.134995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:58.135869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:58.142409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:58.142885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:58.143663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:58.144174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:58.154752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a50c30de-209e-40e8-86b7-c44b1893dc4b tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:58.155357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a50c30de-209e-40e8-86b7-c44b1893dc4b tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:58.161633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a50c30de-209e-40e8-86b7-c44b1893dc4b tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:58.162077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a50c30de-209e-40e8-86b7-c44b1893dc4b tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:58.162867 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a50c30de-209e-40e8-86b7-c44b1893dc4b tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:58.163458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a50c30de-209e-40e8-86b7-c44b1893dc4b tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:58.205812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:58.222015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:58.224723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:58.226553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2b44bdea-445a-4889-aebe-76113c3cd3fd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.096115 Nov 08 17:54:58.228969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 936/1887] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:54:58.327953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a50c30de-209e-40e8-86b7-c44b1893dc4b tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:58.335083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a50c30de-209e-40e8-86b7-c44b1893dc4b tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.183966 Nov 08 17:54:58.336388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 952/1888] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:58 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:54:58.466928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-214c6945-6a3b-4539-8dda-09e45c73003d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:58.467561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-214c6945-6a3b-4539-8dda-09e45c73003d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:58.480623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-214c6945-6a3b-4539-8dda-09e45c73003d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:58.480623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-214c6945-6a3b-4539-8dda-09e45c73003d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:58.480623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-214c6945-6a3b-4539-8dda-09e45c73003d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:58.480623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-214c6945-6a3b-4539-8dda-09e45c73003d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:58.616328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-214c6945-6a3b-4539-8dda-09e45c73003d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:58.624722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-214c6945-6a3b-4539-8dda-09e45c73003d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.163320 Nov 08 17:54:58.625301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 937/1889] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:58 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:59.246298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:59.247033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:59.254073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:59.254538 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:59.255316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:59.255744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:59.327368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:59.336036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:59.337523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:59.338697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-64ad5a6e-99b8-4437-8aa9-42ce0843bf6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.097631 Nov 08 17:54:59.339247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 953/1890] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:54:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:54:59.352704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-03cf933c-c6ec-44ab-afd3-67ff3ac26330 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:59.353313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-03cf933c-c6ec-44ab-afd3-67ff3ac26330 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:59.359908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03cf933c-c6ec-44ab-afd3-67ff3ac26330 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:59.360353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03cf933c-c6ec-44ab-afd3-67ff3ac26330 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:59.361149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03cf933c-c6ec-44ab-afd3-67ff3ac26330 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:59.361584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03cf933c-c6ec-44ab-afd3-67ff3ac26330 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:59.500861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-03cf933c-c6ec-44ab-afd3-67ff3ac26330 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:59.509118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-03cf933c-c6ec-44ab-afd3-67ff3ac26330 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.160463 Nov 08 17:54:59.509891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 938/1891] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:59 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:54:59.642667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2426736c-273b-4cd2-ae48-c48acd9b19a9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:54:59.643297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2426736c-273b-4cd2-ae48-c48acd9b19a9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:54:59.651195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2426736c-273b-4cd2-ae48-c48acd9b19a9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:59.651647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2426736c-273b-4cd2-ae48-c48acd9b19a9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:59.652551 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2426736c-273b-4cd2-ae48-c48acd9b19a9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:54:59.652984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2426736c-273b-4cd2-ae48-c48acd9b19a9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:54:59.794354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2426736c-273b-4cd2-ae48-c48acd9b19a9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:54:59.802755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2426736c-273b-4cd2-ae48-c48acd9b19a9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.163697 Nov 08 17:54:59.803590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 954/1892] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:54:59 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:00.357672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:00.358378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:00.368764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:00.369208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:00.369987 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:00.370414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:00.429966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:00.438966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:00.440453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:00.441609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fba63333-a97a-4d85-8bde-3ea295e90132 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087888 Nov 08 17:55:00.452301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 939/1893] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:00.525759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-68e78208-c438-49fc-9caf-b1b5e1f40465 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:00.526364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-68e78208-c438-49fc-9caf-b1b5e1f40465 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:00.539349 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68e78208-c438-49fc-9caf-b1b5e1f40465 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:00.539797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68e78208-c438-49fc-9caf-b1b5e1f40465 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:00.540589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68e78208-c438-49fc-9caf-b1b5e1f40465 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:00.541025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68e78208-c438-49fc-9caf-b1b5e1f40465 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:00.680208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-68e78208-c438-49fc-9caf-b1b5e1f40465 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:00.687896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-68e78208-c438-49fc-9caf-b1b5e1f40465 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.166307 Nov 08 17:55:00.688675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 955/1894] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:00 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:00.819422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-31b5eb54-549a-4272-996c-92207a6f3bcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:00.820520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-31b5eb54-549a-4272-996c-92207a6f3bcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:00.826383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31b5eb54-549a-4272-996c-92207a6f3bcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:00.826865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31b5eb54-549a-4272-996c-92207a6f3bcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:00.827638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31b5eb54-549a-4272-996c-92207a6f3bcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:00.828076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31b5eb54-549a-4272-996c-92207a6f3bcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:00.961773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-31b5eb54-549a-4272-996c-92207a6f3bcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:00.969582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-31b5eb54-549a-4272-996c-92207a6f3bcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154101 Nov 08 17:55:00.970138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 940/1895] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:00 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:01.459937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:01.461760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:01.468013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:01.468465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:01.469249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:01.469781 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:01.529611 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:01.541107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:01.542773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:01.543957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-447163a1-d1f9-49eb-a189-15d06b4deb2c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087915 Nov 08 17:55:01.544722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 956/1896] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:01.704770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9b0c3716-e8b8-4820-9a90-7a1e7efdc7d9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:01.705407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9b0c3716-e8b8-4820-9a90-7a1e7efdc7d9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:01.712242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b0c3716-e8b8-4820-9a90-7a1e7efdc7d9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:01.712626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b0c3716-e8b8-4820-9a90-7a1e7efdc7d9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:01.713392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b0c3716-e8b8-4820-9a90-7a1e7efdc7d9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:01.713823 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b0c3716-e8b8-4820-9a90-7a1e7efdc7d9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:01.841261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9b0c3716-e8b8-4820-9a90-7a1e7efdc7d9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:01.848337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9b0c3716-e8b8-4820-9a90-7a1e7efdc7d9 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.147229 Nov 08 17:55:01.848900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 941/1897] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:01 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:01.991881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0f5c021c-2364-42b2-b3c5-7da6917f4c11 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:01.991881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0f5c021c-2364-42b2-b3c5-7da6917f4c11 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:01.993633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f5c021c-2364-42b2-b3c5-7da6917f4c11 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:01.994069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f5c021c-2364-42b2-b3c5-7da6917f4c11 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:01.994895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f5c021c-2364-42b2-b3c5-7da6917f4c11 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:01.995319 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f5c021c-2364-42b2-b3c5-7da6917f4c11 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:02.125157 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0f5c021c-2364-42b2-b3c5-7da6917f4c11 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:02.133558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0f5c021c-2364-42b2-b3c5-7da6917f4c11 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150741 Nov 08 17:55:02.134126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 957/1898] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:01 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:02.562733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:02.563323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:02.569146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:02.569588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:02.570371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:02.570831 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:02.638150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:02.646661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:02.648707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:02.650087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0bfca36a-0a27-4fff-982d-56c1cd2c163d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.091047 Nov 08 17:55:02.650989 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 942/1899] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:02.864885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-817f27b3-24c2-4dcb-8302-4b27cfa31855 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:02.865504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-817f27b3-24c2-4dcb-8302-4b27cfa31855 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:02.872508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-817f27b3-24c2-4dcb-8302-4b27cfa31855 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:02.872947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-817f27b3-24c2-4dcb-8302-4b27cfa31855 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:02.873733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-817f27b3-24c2-4dcb-8302-4b27cfa31855 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:02.874154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-817f27b3-24c2-4dcb-8302-4b27cfa31855 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:03.003350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-817f27b3-24c2-4dcb-8302-4b27cfa31855 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:03.012142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-817f27b3-24c2-4dcb-8302-4b27cfa31855 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.150952 Nov 08 17:55:03.012713 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 958/1900] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:02 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:03.150703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dca4119b-fab7-49fc-9804-690ec9c9dc35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:03.151368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dca4119b-fab7-49fc-9804-690ec9c9dc35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:03.157838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dca4119b-fab7-49fc-9804-690ec9c9dc35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:03.158290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dca4119b-fab7-49fc-9804-690ec9c9dc35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:03.159102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dca4119b-fab7-49fc-9804-690ec9c9dc35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:03.159538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dca4119b-fab7-49fc-9804-690ec9c9dc35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:03.548868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dca4119b-fab7-49fc-9804-690ec9c9dc35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:03.557430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dca4119b-fab7-49fc-9804-690ec9c9dc35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.410916 Nov 08 17:55:03.557988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 943/1901] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:03 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:03.667248 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:03.667850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:03.673584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:03.674023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:03.674820 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:03.675243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:03.733145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:03.741728 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:03.743257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:03.744385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1ad52e09-08b9-4a92-ab32-ac0e4e2bd467 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080778 Nov 08 17:55:03.744930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 959/1902] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:04.029575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1359af04-834b-491d-aef3-9a53dbe39c9e tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:04.030185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1359af04-834b-491d-aef3-9a53dbe39c9e tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:04.036090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1359af04-834b-491d-aef3-9a53dbe39c9e tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:04.037203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1359af04-834b-491d-aef3-9a53dbe39c9e tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:04.037439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1359af04-834b-491d-aef3-9a53dbe39c9e tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:04.037703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1359af04-834b-491d-aef3-9a53dbe39c9e tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:04.163250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1359af04-834b-491d-aef3-9a53dbe39c9e tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:04.170415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1359af04-834b-491d-aef3-9a53dbe39c9e tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.144533 Nov 08 17:55:04.170999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 944/1903] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:04 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:04.574642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-61683224-f0f4-4e9b-9f42-39f6f075ed63 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:04.575275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-61683224-f0f4-4e9b-9f42-39f6f075ed63 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:04.581429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61683224-f0f4-4e9b-9f42-39f6f075ed63 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:04.581871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61683224-f0f4-4e9b-9f42-39f6f075ed63 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:04.582652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61683224-f0f4-4e9b-9f42-39f6f075ed63 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:04.583080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61683224-f0f4-4e9b-9f42-39f6f075ed63 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:04.712355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-61683224-f0f4-4e9b-9f42-39f6f075ed63 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:04.720140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-61683224-f0f4-4e9b-9f42-39f6f075ed63 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149119 Nov 08 17:55:04.720702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 960/1904] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:04 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:04.762843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:04.763495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:04.769214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:04.769654 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:04.770415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:04.770875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:04.829301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:04.838163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:04.839682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:04.840839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f881be94-9c28-4f39-adc7-0317b441c41a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081713 Nov 08 17:55:04.841385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 945/1905] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:05.188022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6e6af2ec-6f93-45ad-a71c-d9c1bbefa86c tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:05.188630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6e6af2ec-6f93-45ad-a71c-d9c1bbefa86c tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:05.195141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6e6af2ec-6f93-45ad-a71c-d9c1bbefa86c tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:05.195564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6e6af2ec-6f93-45ad-a71c-d9c1bbefa86c tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:05.196326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6e6af2ec-6f93-45ad-a71c-d9c1bbefa86c tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:05.196760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6e6af2ec-6f93-45ad-a71c-d9c1bbefa86c tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:05.326622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6e6af2ec-6f93-45ad-a71c-d9c1bbefa86c tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:05.331287 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6e6af2ec-6f93-45ad-a71c-d9c1bbefa86c tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.146992 Nov 08 17:55:05.331851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 961/1906] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:05 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:55:05.736853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e4f0187e-50d1-4a44-87c7-deca2eeee6f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:05.737400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e4f0187e-50d1-4a44-87c7-deca2eeee6f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:05.743520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4f0187e-50d1-4a44-87c7-deca2eeee6f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:05.743957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4f0187e-50d1-4a44-87c7-deca2eeee6f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:05.744720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4f0187e-50d1-4a44-87c7-deca2eeee6f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:05.745143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4f0187e-50d1-4a44-87c7-deca2eeee6f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:05.859686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:05.860286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:05.866789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:05.868784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:05.868784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:05.868784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:05.880413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e4f0187e-50d1-4a44-87c7-deca2eeee6f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:05.888861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e4f0187e-50d1-4a44-87c7-deca2eeee6f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155683 Nov 08 17:55:05.894845 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 946/1907] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:05 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:05.928926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:05.936845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:05.938328 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:05.939476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ee357707-8d7d-4ab7-b71a-7595c0ed75f3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083907 Nov 08 17:55:05.940097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 962/1908] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:06.348549 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7ec29adb-0c1e-4daf-85a4-52c7b0d530f7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:06.349070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7ec29adb-0c1e-4daf-85a4-52c7b0d530f7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:06.355429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ec29adb-0c1e-4daf-85a4-52c7b0d530f7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:06.355886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ec29adb-0c1e-4daf-85a4-52c7b0d530f7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:06.356692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ec29adb-0c1e-4daf-85a4-52c7b0d530f7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:06.357130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ec29adb-0c1e-4daf-85a4-52c7b0d530f7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:06.485057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7ec29adb-0c1e-4daf-85a4-52c7b0d530f7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:06.492966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7ec29adb-0c1e-4daf-85a4-52c7b0d530f7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.148301 Nov 08 17:55:06.493519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 947/1909] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:06 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:06.906227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fc84e27c-e081-4681-88da-f34e3f93a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:06.906885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fc84e27c-e081-4681-88da-f34e3f93a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:06.913485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc84e27c-e081-4681-88da-f34e3f93a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:06.913945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc84e27c-e081-4681-88da-f34e3f93a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:06.914732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc84e27c-e081-4681-88da-f34e3f93a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:06.915158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc84e27c-e081-4681-88da-f34e3f93a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:06.956832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:06.957429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:06.963811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:06.964310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:06.965079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:06.965503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:07.040404 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:07.048646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:07.050128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:07.051276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9caba58d-f356-4443-b6a2-875e62b6c493 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.098143 Nov 08 17:55:07.051824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 948/1910] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:07.069252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fc84e27c-e081-4681-88da-f34e3f93a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:07.076986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fc84e27c-e081-4681-88da-f34e3f93a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.174496 Nov 08 17:55:07.078679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 963/1911] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:06 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:07.509868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c9403a8a-cc45-4bfe-875e-a1e768d17717 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:07.510487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c9403a8a-cc45-4bfe-875e-a1e768d17717 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:07.516421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c9403a8a-cc45-4bfe-875e-a1e768d17717 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:07.516859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c9403a8a-cc45-4bfe-875e-a1e768d17717 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:07.517732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c9403a8a-cc45-4bfe-875e-a1e768d17717 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:07.518158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c9403a8a-cc45-4bfe-875e-a1e768d17717 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:07.557068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-869dd302-a712-47ff-bd43-c3304dec9ec5 req-a43d872a-eaf9-485e-9234-4010fbfbe407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e71a891-29d7-4c17-822f-5d7ffec95227", "name": "network-vif-plugged", "status": "completed", "tag": "63f51964-3a06-45fc-8853-d2c8cd7884a9"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:55:07.558777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:55:07.558777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:55:07.566704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-869dd302-a712-47ff-bd43-c3304dec9ec5 req-a43d872a-eaf9-485e-9234-4010fbfbe407 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:07.567330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-869dd302-a712-47ff-bd43-c3304dec9ec5 req-a43d872a-eaf9-485e-9234-4010fbfbe407 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:07.579084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-869dd302-a712-47ff-bd43-c3304dec9ec5 req-a43d872a-eaf9-485e-9234-4010fbfbe407 service nova] Creating event network-vif-plugged:63f51964-3a06-45fc-8853-d2c8cd7884a9 for instance 3e71a891-29d7-4c17-822f-5d7ffec95227 on hv-cinder-81689 Nov 08 17:55:07.584453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-869dd302-a712-47ff-bd43-c3304dec9ec5 req-a43d872a-eaf9-485e-9234-4010fbfbe407 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095777 Nov 08 17:55:07.585973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 949/1912] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:55:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:55:07.658827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c9403a8a-cc45-4bfe-875e-a1e768d17717 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:07.663123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c9403a8a-cc45-4bfe-875e-a1e768d17717 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.157617 Nov 08 17:55:07.663856 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 964/1913] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:07 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:55:08.071716 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:08.072493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:08.078835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:08.079273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:08.080036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:08.080460 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:08.092697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-05969394-64c5-4421-84a7-03358cb29275 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:08.093309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-05969394-64c5-4421-84a7-03358cb29275 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:08.099506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05969394-64c5-4421-84a7-03358cb29275 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:08.100014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05969394-64c5-4421-84a7-03358cb29275 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:08.100824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05969394-64c5-4421-84a7-03358cb29275 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:08.101406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-05969394-64c5-4421-84a7-03358cb29275 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:08.192640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:08.201942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:08.203445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:08.204565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-81c834af-7721-4a22-8ec3-7773e77c1ad4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.137418 Nov 08 17:55:08.205113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 950/1914] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:08.256608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-05969394-64c5-4421-84a7-03358cb29275 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:08.264872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-05969394-64c5-4421-84a7-03358cb29275 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.175817 Nov 08 17:55:08.265428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 965/1915] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:08 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:55:08.680511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0d06ce97-e048-4f30-af33-576cf1ebd2ff tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:08.681137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0d06ce97-e048-4f30-af33-576cf1ebd2ff tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:08.686814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d06ce97-e048-4f30-af33-576cf1ebd2ff tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:08.687254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d06ce97-e048-4f30-af33-576cf1ebd2ff tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:08.688012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d06ce97-e048-4f30-af33-576cf1ebd2ff tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:08.688439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d06ce97-e048-4f30-af33-576cf1ebd2ff tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:08.815075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0d06ce97-e048-4f30-af33-576cf1ebd2ff tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:08.822588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0d06ce97-e048-4f30-af33-576cf1ebd2ff tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1357 microversion: 2.1 time: 0.145718 Nov 08 17:55:08.827145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 951/1916] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:08 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:09.221464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:09.222068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:09.228391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:09.228830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:09.229850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:09.230279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:09.280983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-da29f15c-f546-4e9d-b590-0b08e8d40734 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:09.281526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-da29f15c-f546-4e9d-b590-0b08e8d40734 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:09.287785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da29f15c-f546-4e9d-b590-0b08e8d40734 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:09.288288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da29f15c-f546-4e9d-b590-0b08e8d40734 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:09.289067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da29f15c-f546-4e9d-b590-0b08e8d40734 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:09.290262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da29f15c-f546-4e9d-b590-0b08e8d40734 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:09.292254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:09.300477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:09.302052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:09.303374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a160ff4f-760c-4a14-889a-163c22d3828e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085702 Nov 08 17:55:09.304041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 966/1917] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:09.417282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-da29f15c-f546-4e9d-b590-0b08e8d40734 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:09.424927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-da29f15c-f546-4e9d-b590-0b08e8d40734 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147757 Nov 08 17:55:09.425493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 952/1918] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:09 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:55:09.838833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9b8efd36-0cc0-4cc2-a358-10f1606ce84f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:09.839435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9b8efd36-0cc0-4cc2-a358-10f1606ce84f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:09.845256 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9b8efd36-0cc0-4cc2-a358-10f1606ce84f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:09.847341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9b8efd36-0cc0-4cc2-a358-10f1606ce84f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:09.847341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9b8efd36-0cc0-4cc2-a358-10f1606ce84f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:09.847341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9b8efd36-0cc0-4cc2-a358-10f1606ce84f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.035718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9b8efd36-0cc0-4cc2-a358-10f1606ce84f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:10.046366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9b8efd36-0cc0-4cc2-a358-10f1606ce84f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1546 microversion: 2.1 time: 0.211609 Nov 08 17:55:10.046959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 967/1919] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:09 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:10.062518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9934990c-7026-4f1e-97d9-98778f5c4369 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:10.063145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9934990c-7026-4f1e-97d9-98778f5c4369 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:10.068804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9934990c-7026-4f1e-97d9-98778f5c4369 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.069336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9934990c-7026-4f1e-97d9-98778f5c4369 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.070105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9934990c-7026-4f1e-97d9-98778f5c4369 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.070566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9934990c-7026-4f1e-97d9-98778f5c4369 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.201340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9934990c-7026-4f1e-97d9-98778f5c4369 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:10.208508 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9934990c-7026-4f1e-97d9-98778f5c4369 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1546 microversion: 2.1 time: 0.149576 Nov 08 17:55:10.209062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 953/1920] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:10 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:10.224238 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:10.228461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:55:10.228461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 17:55:10.229734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:10.230488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Searching by: {'deleted': False, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7'} {{(pid=127762) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 08 17:55:10.237362 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.237803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.238645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.239074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.321426 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:10.322029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:10.327142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.multi_cell_list [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127762) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 08 17:55:10.328236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.328677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.329449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.329880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.391077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:10.399745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:10.401315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:10.402389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-14460d1c-9e27-4d43-8999-73800974c5c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084745 Nov 08 17:55:10.402979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 954/1921] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:10.434348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-78a6c8d4-1803-4c9e-876c-e7d0fcb4bdc7 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213694 Nov 08 17:55:10.434962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 968/1922] 10.222.0.18 () {58 vars in 1124 bytes} [Mon Nov 8 17:55:10 2021] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:55:10.441929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7bb2d532-1295-470b-b864-9802c45a182a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:10.444185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7bb2d532-1295-470b-b864-9802c45a182a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:10.444739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3da71f1a-9fa4-45e5-9064-2d77f265450f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:10.445544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3da71f1a-9fa4-45e5-9064-2d77f265450f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:10.448777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bb2d532-1295-470b-b864-9802c45a182a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.449217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bb2d532-1295-470b-b864-9802c45a182a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.449992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bb2d532-1295-470b-b864-9802c45a182a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.450425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bb2d532-1295-470b-b864-9802c45a182a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.451288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3da71f1a-9fa4-45e5-9064-2d77f265450f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.451735 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3da71f1a-9fa4-45e5-9064-2d77f265450f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.452504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3da71f1a-9fa4-45e5-9064-2d77f265450f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:10.452933 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3da71f1a-9fa4-45e5-9064-2d77f265450f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:10.643022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7bb2d532-1295-470b-b864-9802c45a182a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:10.646163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3da71f1a-9fa4-45e5-9064-2d77f265450f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:10.651843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7bb2d532-1295-470b-b864-9802c45a182a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.213547 Nov 08 17:55:10.652347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 955/1923] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:10 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:10.654322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3da71f1a-9fa4-45e5-9064-2d77f265450f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1546 microversion: 2.1 time: 0.213103 Nov 08 17:55:10.654970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 969/1924] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:10 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:55:11.420954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:11.421543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:11.428471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:11.429658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:11.430622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:11.435648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:11.495576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:11.503985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:11.505478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:11.506885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9cb5115e-dc71-439f-a722-156416ac41d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.089550 Nov 08 17:55:11.507538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 956/1925] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:11.669282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7247b4ad-b662-4d6a-b9bd-a18592253232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:11.669887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7247b4ad-b662-4d6a-b9bd-a18592253232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:11.676292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7247b4ad-b662-4d6a-b9bd-a18592253232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:11.676669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7247b4ad-b662-4d6a-b9bd-a18592253232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:11.677441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7247b4ad-b662-4d6a-b9bd-a18592253232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:11.677868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7247b4ad-b662-4d6a-b9bd-a18592253232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:11.826515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7247b4ad-b662-4d6a-b9bd-a18592253232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:11.834504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7247b4ad-b662-4d6a-b9bd-a18592253232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.168891 Nov 08 17:55:11.835071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 970/1926] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:11 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:12.526788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:12.527437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:12.533706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:12.534141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:12.534927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:12.535354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:12.592689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:12.600730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:12.603182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:12.604295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-818edbb8-7fb9-463c-8b7c-6dca4a40d371 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081766 Nov 08 17:55:12.605081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 957/1927] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:12.852998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-90c60d85-c2dc-4d0d-9b8c-6a54f12e1d4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:12.853664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-90c60d85-c2dc-4d0d-9b8c-6a54f12e1d4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:12.860359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90c60d85-c2dc-4d0d-9b8c-6a54f12e1d4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:12.860808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90c60d85-c2dc-4d0d-9b8c-6a54f12e1d4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:12.861578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90c60d85-c2dc-4d0d-9b8c-6a54f12e1d4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:12.862011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90c60d85-c2dc-4d0d-9b8c-6a54f12e1d4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:12.989518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-90c60d85-c2dc-4d0d-9b8c-6a54f12e1d4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:12.998583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-90c60d85-c2dc-4d0d-9b8c-6a54f12e1d4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149917 Nov 08 17:55:12.999371 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 971/1928] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:12 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:13.621492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:13.622075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:13.627863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:13.628308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:13.629070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:13.629498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:13.687044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:13.695535 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:13.697010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:13.698129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8a021601-c31e-44bf-81d2-cc50c6146db9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080527 Nov 08 17:55:13.698715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 958/1929] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:14.015581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-34fb4e70-5012-4e19-aecc-a9525957ed2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:14.016177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-34fb4e70-5012-4e19-aecc-a9525957ed2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:14.021961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34fb4e70-5012-4e19-aecc-a9525957ed2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:14.022399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34fb4e70-5012-4e19-aecc-a9525957ed2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:14.023336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34fb4e70-5012-4e19-aecc-a9525957ed2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:14.023811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34fb4e70-5012-4e19-aecc-a9525957ed2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:14.152115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-34fb4e70-5012-4e19-aecc-a9525957ed2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:14.159701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-34fb4e70-5012-4e19-aecc-a9525957ed2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147983 Nov 08 17:55:14.160262 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 972/1930] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:14 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:14.716613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:14.717208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:14.723532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:14.723977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:14.724765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:14.725204 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:14.785629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:14.794419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:14.795934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:14.797067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-90a9470d-2116-4e86-8f5d-a347840e7b97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084141 Nov 08 17:55:14.797622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 959/1931] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:15.176406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0bf4b798-0de9-44c2-96d6-eec6e14878a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:15.177009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0bf4b798-0de9-44c2-96d6-eec6e14878a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:15.183271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0bf4b798-0de9-44c2-96d6-eec6e14878a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:15.183707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0bf4b798-0de9-44c2-96d6-eec6e14878a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:15.184465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0bf4b798-0de9-44c2-96d6-eec6e14878a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:15.184890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0bf4b798-0de9-44c2-96d6-eec6e14878a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:15.311391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0bf4b798-0de9-44c2-96d6-eec6e14878a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:15.319090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0bf4b798-0de9-44c2-96d6-eec6e14878a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146320 Nov 08 17:55:15.320179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 973/1932] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:15 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:15.815593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:15.816175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:15.823130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:15.823569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:15.824327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:15.824754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:15.887079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:15.895256 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:15.896788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:15.898533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f9babae7-ef5d-4450-9fcc-3183a25674fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086205 Nov 08 17:55:15.899096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 960/1933] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:16.338191 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1ca4cf18-d7ad-4bce-8173-f5c276ec053d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:16.338825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1ca4cf18-d7ad-4bce-8173-f5c276ec053d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:16.345140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ca4cf18-d7ad-4bce-8173-f5c276ec053d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:16.345582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ca4cf18-d7ad-4bce-8173-f5c276ec053d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:16.346348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ca4cf18-d7ad-4bce-8173-f5c276ec053d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:16.346807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ca4cf18-d7ad-4bce-8173-f5c276ec053d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:16.473895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1ca4cf18-d7ad-4bce-8173-f5c276ec053d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:16.481784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1ca4cf18-d7ad-4bce-8173-f5c276ec053d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147262 Nov 08 17:55:16.482342 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 974/1934] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:16 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:16.916985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:16.917594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:16.923973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:16.924422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:16.925198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:16.925635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:16.984692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:16.993112 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:16.994706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:16.995833 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-795d91ac-5529-4b21-8c18-a09357002ab2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083311 Nov 08 17:55:16.996387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 961/1935] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:17.498638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-721716c1-136a-43fc-87a7-3470c9fd6f0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:17.499259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-721716c1-136a-43fc-87a7-3470c9fd6f0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:17.505816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-721716c1-136a-43fc-87a7-3470c9fd6f0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:17.507599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-721716c1-136a-43fc-87a7-3470c9fd6f0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:17.507599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-721716c1-136a-43fc-87a7-3470c9fd6f0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:17.508359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-721716c1-136a-43fc-87a7-3470c9fd6f0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:17.643960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-721716c1-136a-43fc-87a7-3470c9fd6f0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:17.652271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-721716c1-136a-43fc-87a7-3470c9fd6f0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.157299 Nov 08 17:55:17.652810 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 975/1936] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:17 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:18.013600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:18.014196 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:18.020429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:18.020868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:18.021631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:18.022055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:18.080587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:18.089252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:18.090755 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:18.091869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0d77d36d-692b-439e-8e1a-2e28753d6c60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081992 Nov 08 17:55:18.092415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 962/1937] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:18.668751 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d08b70ab-75d1-4369-b3b3-02dec351f1a1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:18.669380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d08b70ab-75d1-4369-b3b3-02dec351f1a1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:18.675556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d08b70ab-75d1-4369-b3b3-02dec351f1a1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:18.675996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d08b70ab-75d1-4369-b3b3-02dec351f1a1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:18.676742 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d08b70ab-75d1-4369-b3b3-02dec351f1a1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:18.677171 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d08b70ab-75d1-4369-b3b3-02dec351f1a1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:18.803819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d08b70ab-75d1-4369-b3b3-02dec351f1a1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:18.812000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d08b70ab-75d1-4369-b3b3-02dec351f1a1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146877 Nov 08 17:55:18.812554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 976/1938] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:18 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:19.109365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:19.109948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:19.116232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:19.117305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:19.118071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:19.118526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:19.178496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:19.186826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:19.188314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:19.189456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-920380b4-c013-445a-a991-17716b2f733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083817 Nov 08 17:55:19.190012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 963/1939] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:19.828385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f6cacac7-4481-406b-b643-63f4d0aeb41d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:19.828978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f6cacac7-4481-406b-b643-63f4d0aeb41d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:19.836377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6cacac7-4481-406b-b643-63f4d0aeb41d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:19.836848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6cacac7-4481-406b-b643-63f4d0aeb41d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:19.837663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6cacac7-4481-406b-b643-63f4d0aeb41d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:19.838087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f6cacac7-4481-406b-b643-63f4d0aeb41d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:19.970353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f6cacac7-4481-406b-b643-63f4d0aeb41d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:19.978715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f6cacac7-4481-406b-b643-63f4d0aeb41d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153990 Nov 08 17:55:19.979554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 977/1940] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:19 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:20.206958 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:20.207558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:20.213811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:20.214253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:20.215047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:20.215475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:20.273583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:20.281562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:20.283065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:20.284175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0632793e-eed6-4599-b05b-2626b53427a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080930 Nov 08 17:55:20.284729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 964/1941] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:20.995522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b7b88a95-ec12-449c-aaa7-97cd99159e3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:20.996143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b7b88a95-ec12-449c-aaa7-97cd99159e3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:21.002731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b7b88a95-ec12-449c-aaa7-97cd99159e3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:21.003325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b7b88a95-ec12-449c-aaa7-97cd99159e3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:21.004103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b7b88a95-ec12-449c-aaa7-97cd99159e3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:21.004536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b7b88a95-ec12-449c-aaa7-97cd99159e3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:21.133267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b7b88a95-ec12-449c-aaa7-97cd99159e3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:21.140948 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b7b88a95-ec12-449c-aaa7-97cd99159e3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149293 Nov 08 17:55:21.141511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 978/1942] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:20 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:55:21.302758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:21.303353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:21.309776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:21.314964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:21.314964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:21.314964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:21.373418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:21.381728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:21.389567 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:21.389567 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c7e46483-2112-4022-bd5b-c2a0e9b57542 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086058 Nov 08 17:55:21.389567 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 965/1943] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:22.158321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f8a5e6ac-6cdb-4cc9-9173-c7650de4bcd5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:22.158958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f8a5e6ac-6cdb-4cc9-9173-c7650de4bcd5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:22.165138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8a5e6ac-6cdb-4cc9-9173-c7650de4bcd5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:22.165574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8a5e6ac-6cdb-4cc9-9173-c7650de4bcd5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:22.166343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8a5e6ac-6cdb-4cc9-9173-c7650de4bcd5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:22.166802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8a5e6ac-6cdb-4cc9-9173-c7650de4bcd5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:22.295696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f8a5e6ac-6cdb-4cc9-9173-c7650de4bcd5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:22.303299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f8a5e6ac-6cdb-4cc9-9173-c7650de4bcd5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148629 Nov 08 17:55:22.303850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 979/1944] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:22 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:22.402826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:22.403421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:22.409577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:22.410010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:22.410816 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:22.411257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:22.469292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:22.477448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:22.478959 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:22.480328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7768702b-c61b-47ab-98d7-0951abb54f6e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081214 Nov 08 17:55:22.480882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 966/1945] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:23.319884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fbde0c80-c249-4d0a-b3d5-5fa7cb1fa8e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:23.321350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fbde0c80-c249-4d0a-b3d5-5fa7cb1fa8e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:23.327566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbde0c80-c249-4d0a-b3d5-5fa7cb1fa8e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:23.328003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbde0c80-c249-4d0a-b3d5-5fa7cb1fa8e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:23.328761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbde0c80-c249-4d0a-b3d5-5fa7cb1fa8e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:23.329185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fbde0c80-c249-4d0a-b3d5-5fa7cb1fa8e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:23.460878 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fbde0c80-c249-4d0a-b3d5-5fa7cb1fa8e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:23.469019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fbde0c80-c249-4d0a-b3d5-5fa7cb1fa8e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152834 Nov 08 17:55:23.469582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 980/1946] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:23 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:23.497960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:23.498585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:23.504712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:23.505149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:23.505906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:23.506333 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:23.563842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:23.572447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:23.573857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:23.575014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9c8683ad-d57f-4f05-8475-f292a1489b26 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080666 Nov 08 17:55:23.575561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 967/1947] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:24.485554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d902e019-23bd-4029-bcc5-5c3768b78091 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:24.486158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d902e019-23bd-4029-bcc5-5c3768b78091 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:24.492466 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d902e019-23bd-4029-bcc5-5c3768b78091 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:24.492910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d902e019-23bd-4029-bcc5-5c3768b78091 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:24.493673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d902e019-23bd-4029-bcc5-5c3768b78091 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:24.494103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d902e019-23bd-4029-bcc5-5c3768b78091 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:24.592963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:24.593566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:24.599903 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:24.600370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:24.601169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:24.602174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:24.622790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d902e019-23bd-4029-bcc5-5c3768b78091 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:24.630412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d902e019-23bd-4029-bcc5-5c3768b78091 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148496 Nov 08 17:55:24.631006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 981/1948] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:24 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:24.665132 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:24.673151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:24.674668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:24.675793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-45b605d0-a66b-4f7c-84dd-0fdf7cbfe858 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086571 Nov 08 17:55:24.676343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 968/1949] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:25.647389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-73e9e5c3-ab9d-48d7-9e0a-157a9e44c3af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:25.654773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-73e9e5c3-ab9d-48d7-9e0a-157a9e44c3af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:25.655785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73e9e5c3-ab9d-48d7-9e0a-157a9e44c3af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:25.656234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73e9e5c3-ab9d-48d7-9e0a-157a9e44c3af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:25.657008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73e9e5c3-ab9d-48d7-9e0a-157a9e44c3af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:25.657441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73e9e5c3-ab9d-48d7-9e0a-157a9e44c3af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:25.693939 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:25.694657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:25.701439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:25.701923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:25.702869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:25.703371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:25.776267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:25.784416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:25.785906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:25.787062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e7ee1a69-8285-42d8-88ec-ba99952249e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.096824 Nov 08 17:55:25.787617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 969/1950] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:25.810969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-73e9e5c3-ab9d-48d7-9e0a-157a9e44c3af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:25.818563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-73e9e5c3-ab9d-48d7-9e0a-157a9e44c3af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.174811 Nov 08 17:55:25.819129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 982/1951] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:25 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:26.805908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:26.806595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:26.812855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:26.813297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:26.814062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:26.814523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:26.835062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8710ea76-0747-41c2-9956-ff1b37f8dd99 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:26.835739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8710ea76-0747-41c2-9956-ff1b37f8dd99 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:26.843062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8710ea76-0747-41c2-9956-ff1b37f8dd99 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:26.843555 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8710ea76-0747-41c2-9956-ff1b37f8dd99 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:26.844408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8710ea76-0747-41c2-9956-ff1b37f8dd99 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:26.844888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8710ea76-0747-41c2-9956-ff1b37f8dd99 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:26.873757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:26.881935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:26.884085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:26.885216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-89c1acb9-2946-4535-a874-23331116039e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083690 Nov 08 17:55:26.885768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 970/1952] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:26.973066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8710ea76-0747-41c2-9956-ff1b37f8dd99 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:26.981198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8710ea76-0747-41c2-9956-ff1b37f8dd99 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149698 Nov 08 17:55:26.981778 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 983/1953] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:26 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:27.903814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:27.904413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:27.910701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:27.911129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:27.911892 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:27.912345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:27.973413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:27.981857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:27.983365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:27.984480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1e813ecc-63f4-4bc2-9dc1-1b0f73794a03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084425 Nov 08 17:55:27.985039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 971/1954] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:27.996904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-959a9ff8-46eb-4a2c-bd08-936a41ad5398 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:27.997517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-959a9ff8-46eb-4a2c-bd08-936a41ad5398 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:28.003964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-959a9ff8-46eb-4a2c-bd08-936a41ad5398 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:28.004406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-959a9ff8-46eb-4a2c-bd08-936a41ad5398 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:28.005184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-959a9ff8-46eb-4a2c-bd08-936a41ad5398 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:28.005622 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-959a9ff8-46eb-4a2c-bd08-936a41ad5398 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:28.136092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-959a9ff8-46eb-4a2c-bd08-936a41ad5398 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:28.144070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-959a9ff8-46eb-4a2c-bd08-936a41ad5398 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150922 Nov 08 17:55:28.145009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 984/1955] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:27 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:29.003063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:29.003665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:29.010505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:29.010954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:29.011744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:29.012268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:29.071942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:29.080105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:29.081640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:29.082809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-402d848a-7508-40a6-8799-e7140c8b9535 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083482 Nov 08 17:55:29.083358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 972/1956] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:29.163128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d4cb59f3-eca9-428d-a485-b8919b012bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:29.163745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d4cb59f3-eca9-428d-a485-b8919b012bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:29.169961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d4cb59f3-eca9-428d-a485-b8919b012bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:29.170408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d4cb59f3-eca9-428d-a485-b8919b012bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:29.171199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d4cb59f3-eca9-428d-a485-b8919b012bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:29.171631 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d4cb59f3-eca9-428d-a485-b8919b012bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:29.300215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d4cb59f3-eca9-428d-a485-b8919b012bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:29.308920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d4cb59f3-eca9-428d-a485-b8919b012bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149374 Nov 08 17:55:29.309485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 985/1957] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:29 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:30.100407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:30.101007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:30.108000 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:30.108443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:30.109206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:30.109637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:30.167161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:30.175162 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:30.176662 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:30.177783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7fed62f7-b1ee-41f1-bd30-b64e0f3a25db tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081127 Nov 08 17:55:30.178339 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 973/1958] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:30.326077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-61cb428a-0161-4a4c-b8f1-d0f2a144cb4e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:30.326641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-61cb428a-0161-4a4c-b8f1-d0f2a144cb4e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:30.332970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61cb428a-0161-4a4c-b8f1-d0f2a144cb4e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:30.333421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61cb428a-0161-4a4c-b8f1-d0f2a144cb4e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:30.334195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61cb428a-0161-4a4c-b8f1-d0f2a144cb4e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:30.334653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61cb428a-0161-4a4c-b8f1-d0f2a144cb4e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:30.464872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-61cb428a-0161-4a4c-b8f1-d0f2a144cb4e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:30.472581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-61cb428a-0161-4a4c-b8f1-d0f2a144cb4e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150267 Nov 08 17:55:30.473138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 986/1959] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:30 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:30.475462 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:55:30.475683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:55:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:55:31.196435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:31.197140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:31.203228 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:31.203698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:31.204464 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:31.204901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:31.263727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:31.271984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:31.274240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:31.275191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-797f77b1-d035-44df-a0b8-d508b9f98c7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083130 Nov 08 17:55:31.275750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 974/1960] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:31.489708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-274b55bf-f20c-4c42-b928-0214f287851a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:31.490310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-274b55bf-f20c-4c42-b928-0214f287851a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:31.496641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-274b55bf-f20c-4c42-b928-0214f287851a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:31.497079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-274b55bf-f20c-4c42-b928-0214f287851a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:31.497862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-274b55bf-f20c-4c42-b928-0214f287851a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:31.498289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-274b55bf-f20c-4c42-b928-0214f287851a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:31.626874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-274b55bf-f20c-4c42-b928-0214f287851a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:31.635017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-274b55bf-f20c-4c42-b928-0214f287851a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149012 Nov 08 17:55:31.635589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 987/1961] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:31 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:32.293485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:32.294027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:32.300185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:32.300635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:32.301415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:32.301825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:32.361004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:32.369767 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:32.371283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:32.372405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7a13378f-9edb-4a71-be04-ece3c5f77d5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082716 Nov 08 17:55:32.372954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 975/1962] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:32.652669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-67a5433e-f311-49c4-b9ce-17de71fcd70e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:32.653298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-67a5433e-f311-49c4-b9ce-17de71fcd70e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:32.661239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-67a5433e-f311-49c4-b9ce-17de71fcd70e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:32.661677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-67a5433e-f311-49c4-b9ce-17de71fcd70e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:32.662438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-67a5433e-f311-49c4-b9ce-17de71fcd70e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:32.662956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-67a5433e-f311-49c4-b9ce-17de71fcd70e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:32.790789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-67a5433e-f311-49c4-b9ce-17de71fcd70e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:32.798344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-67a5433e-f311-49c4-b9ce-17de71fcd70e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149818 Nov 08 17:55:32.798930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 988/1963] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:32 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:33.390299 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:33.390946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:33.397138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:33.397577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:33.398590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:33.399023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:33.459881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:33.468530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:33.469999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:33.471139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5184fc47-a862-41f2-b372-a8e302b45b02 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084548 Nov 08 17:55:33.471689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 976/1964] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:33.814991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-07cc028e-2df4-40d2-aedf-d1477fa3cce1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:33.815522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-07cc028e-2df4-40d2-aedf-d1477fa3cce1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:33.821698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07cc028e-2df4-40d2-aedf-d1477fa3cce1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:33.822137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07cc028e-2df4-40d2-aedf-d1477fa3cce1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:33.822926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07cc028e-2df4-40d2-aedf-d1477fa3cce1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:33.823352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07cc028e-2df4-40d2-aedf-d1477fa3cce1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:33.948771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-07cc028e-2df4-40d2-aedf-d1477fa3cce1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:33.956439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-07cc028e-2df4-40d2-aedf-d1477fa3cce1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145107 Nov 08 17:55:33.957004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 989/1965] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:33 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:34.488682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:34.489278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:34.495579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:34.496020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:34.496777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:34.497205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:34.554890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:34.563023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:34.564497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:34.565609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e7148de1-e458-4a12-b15c-d720217a3354 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080662 Nov 08 17:55:34.566159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 977/1966] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:34.972846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7e0404b8-e4f8-4a92-a9c5-c8cf4e5da24d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:34.973454 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7e0404b8-e4f8-4a92-a9c5-c8cf4e5da24d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:34.980096 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e0404b8-e4f8-4a92-a9c5-c8cf4e5da24d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:34.980540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e0404b8-e4f8-4a92-a9c5-c8cf4e5da24d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:34.981311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e0404b8-e4f8-4a92-a9c5-c8cf4e5da24d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:34.981738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7e0404b8-e4f8-4a92-a9c5-c8cf4e5da24d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:35.074350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:55:35.074548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 17:55:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe (ip 10.222.0.18) !!! Nov 08 17:55:35.119039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7e0404b8-e4f8-4a92-a9c5-c8cf4e5da24d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:35.126745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7e0404b8-e4f8-4a92-a9c5-c8cf4e5da24d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.157616 Nov 08 17:55:35.127306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 990/1967] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:34 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:35.583246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:35.583779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:35.590648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:35.591094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:35.591861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:35.592292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:35.651248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:35.659754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:35.662019 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:35.662378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-180bd588-5b3c-47d9-beac-90abca2f2fa2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082848 Nov 08 17:55:35.662952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 978/1968] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:36.144096 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-94d60690-d69e-4815-b8c7-ec7df1342a03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:36.144831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-94d60690-d69e-4815-b8c7-ec7df1342a03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:36.151018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94d60690-d69e-4815-b8c7-ec7df1342a03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:36.151454 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94d60690-d69e-4815-b8c7-ec7df1342a03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:36.152236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94d60690-d69e-4815-b8c7-ec7df1342a03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:36.152661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94d60690-d69e-4815-b8c7-ec7df1342a03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:36.282643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-94d60690-d69e-4815-b8c7-ec7df1342a03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:36.291565 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-94d60690-d69e-4815-b8c7-ec7df1342a03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151181 Nov 08 17:55:36.292133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 991/1969] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:36 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:36.680189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:36.680791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:36.687024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:36.687463 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:36.688233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:36.688662 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:36.748331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:36.756217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:36.758206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:36.759387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b2975be7-734b-4986-9598-d5bb88e36fab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083021 Nov 08 17:55:36.759933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 979/1970] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:37.308740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1a7a1288-e635-4e8a-abcb-ab91bc817433 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:37.309280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1a7a1288-e635-4e8a-abcb-ab91bc817433 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:37.315568 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a7a1288-e635-4e8a-abcb-ab91bc817433 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:37.316014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a7a1288-e635-4e8a-abcb-ab91bc817433 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:37.316799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a7a1288-e635-4e8a-abcb-ab91bc817433 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:37.317221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a7a1288-e635-4e8a-abcb-ab91bc817433 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:37.446966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1a7a1288-e635-4e8a-abcb-ab91bc817433 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:37.454649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1a7a1288-e635-4e8a-abcb-ab91bc817433 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150165 Nov 08 17:55:37.455222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 992/1971] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:37 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:37.776990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:37.777597 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:37.783961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:37.784402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:37.785165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:37.785593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:37.843927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:37.852677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:37.854478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:37.855597 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ccf33840-6ec9-4175-a36f-62723f71b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082375 Nov 08 17:55:37.856152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 980/1972] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:38.471424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fc3c9626-5286-41e6-8c21-adad4eba4167 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:38.472031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fc3c9626-5286-41e6-8c21-adad4eba4167 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:38.478370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc3c9626-5286-41e6-8c21-adad4eba4167 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:38.478841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc3c9626-5286-41e6-8c21-adad4eba4167 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:38.479872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc3c9626-5286-41e6-8c21-adad4eba4167 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:38.480303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc3c9626-5286-41e6-8c21-adad4eba4167 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:38.606548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fc3c9626-5286-41e6-8c21-adad4eba4167 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:38.614108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fc3c9626-5286-41e6-8c21-adad4eba4167 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146312 Nov 08 17:55:38.614714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 993/1973] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:38 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:38.873477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:38.874070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:38.880404 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:38.880837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:38.881593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:38.882016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:38.942394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:38.951305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:38.952793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:38.953982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3d644145-1c66-417c-9c49-c9387e65f5a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084214 Nov 08 17:55:38.954583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 981/1974] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:39.631372 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1cd092ec-1a9b-4ae1-8a17-1823ee0fe74c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:39.631982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1cd092ec-1a9b-4ae1-8a17-1823ee0fe74c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:39.638302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cd092ec-1a9b-4ae1-8a17-1823ee0fe74c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:39.638774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cd092ec-1a9b-4ae1-8a17-1823ee0fe74c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:39.639540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cd092ec-1a9b-4ae1-8a17-1823ee0fe74c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:39.639973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cd092ec-1a9b-4ae1-8a17-1823ee0fe74c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:39.765001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1cd092ec-1a9b-4ae1-8a17-1823ee0fe74c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:39.772613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1cd092ec-1a9b-4ae1-8a17-1823ee0fe74c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.144898 Nov 08 17:55:39.773180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 994/1975] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:39 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:39.971999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:39.972550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:39.979221 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:39.979662 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:39.980423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:39.980850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:40.040197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:40.048329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:40.049812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:40.050961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ae674452-17ce-472f-a344-b6fbd570c1d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082741 Nov 08 17:55:40.057130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 982/1976] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:40.789808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bf008b2f-0069-498a-b0e4-900ca8aaf8b1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:40.790423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bf008b2f-0069-498a-b0e4-900ca8aaf8b1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:40.797267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf008b2f-0069-498a-b0e4-900ca8aaf8b1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:40.797702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf008b2f-0069-498a-b0e4-900ca8aaf8b1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:40.798475 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf008b2f-0069-498a-b0e4-900ca8aaf8b1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:40.798905 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf008b2f-0069-498a-b0e4-900ca8aaf8b1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:40.926943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bf008b2f-0069-498a-b0e4-900ca8aaf8b1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:40.936780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bf008b2f-0069-498a-b0e4-900ca8aaf8b1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150578 Nov 08 17:55:40.937342 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 995/1977] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:40 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:41.069025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:41.069562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:41.075707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:41.076147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:41.077011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:41.077441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:41.135794 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:41.143814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:41.145492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:41.146640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2278ebc0-1991-47b8-9736-b8f8e9e5a0bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081452 Nov 08 17:55:41.147184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 983/1978] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:41.953097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e2a0dc5d-1036-478c-ad0a-279316eb2ebd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:41.953777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e2a0dc5d-1036-478c-ad0a-279316eb2ebd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:41.960185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2a0dc5d-1036-478c-ad0a-279316eb2ebd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:41.960627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2a0dc5d-1036-478c-ad0a-279316eb2ebd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:41.961416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2a0dc5d-1036-478c-ad0a-279316eb2ebd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:41.961881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2a0dc5d-1036-478c-ad0a-279316eb2ebd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:42.088773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e2a0dc5d-1036-478c-ad0a-279316eb2ebd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:42.096565 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e2a0dc5d-1036-478c-ad0a-279316eb2ebd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147099 Nov 08 17:55:42.097130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 996/1979] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:41 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:42.164835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:42.165428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:42.172188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:42.172627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:42.173383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:42.173807 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:42.233715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:42.242033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:42.244769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:42.244769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9fe81e5b-0ecd-4acb-8d2b-59586ccc7409 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083433 Nov 08 17:55:42.245746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 984/1980] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:43.114040 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1e7de70e-4ceb-4e10-90cc-467b7a6e2598 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:43.114676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1e7de70e-4ceb-4e10-90cc-467b7a6e2598 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:43.120911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e7de70e-4ceb-4e10-90cc-467b7a6e2598 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:43.121356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e7de70e-4ceb-4e10-90cc-467b7a6e2598 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:43.122674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e7de70e-4ceb-4e10-90cc-467b7a6e2598 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:43.123107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e7de70e-4ceb-4e10-90cc-467b7a6e2598 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:43.253819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1e7de70e-4ceb-4e10-90cc-467b7a6e2598 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:43.261832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1e7de70e-4ceb-4e10-90cc-467b7a6e2598 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151365 Nov 08 17:55:43.263269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:43.263812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 997/1981] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:43 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:43.263929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:43.269538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:43.269977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:43.270775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:43.271208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:43.329551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:43.337282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:43.338815 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:43.339927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cc473ba1-4a1a-44ce-a292-9812675fce45 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081499 Nov 08 17:55:43.340686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 985/1982] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:44.279744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a52f654e-52c0-4c4b-aa13-3ef3b857099c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:44.280273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a52f654e-52c0-4c4b-aa13-3ef3b857099c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:44.286311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a52f654e-52c0-4c4b-aa13-3ef3b857099c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:44.286805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a52f654e-52c0-4c4b-aa13-3ef3b857099c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:44.287611 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a52f654e-52c0-4c4b-aa13-3ef3b857099c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:44.288047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a52f654e-52c0-4c4b-aa13-3ef3b857099c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:44.358288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:44.358933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:44.365104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:44.365542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:44.366885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:44.366885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:44.442279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:44.447315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a52f654e-52c0-4c4b-aa13-3ef3b857099c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:44.450651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:44.452152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:44.453289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4ef0b82b-780d-4501-9b60-abef9f4725e8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.099905 Nov 08 17:55:44.453846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 986/1983] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:55:44.454957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a52f654e-52c0-4c4b-aa13-3ef3b857099c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.179400 Nov 08 17:55:44.455513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 998/1984] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:44 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:45.471066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:45.471654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-22ef086b-0648-47d8-b30e-ced98dbfdd35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:45.472037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:45.472145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-22ef086b-0648-47d8-b30e-ced98dbfdd35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:45.478099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22ef086b-0648-47d8-b30e-ced98dbfdd35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:45.478283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:45.478574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22ef086b-0648-47d8-b30e-ced98dbfdd35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:45.478719 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:45.479608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:45.479721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22ef086b-0648-47d8-b30e-ced98dbfdd35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:45.480046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22ef086b-0648-47d8-b30e-ced98dbfdd35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:45.480193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:45.558130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:45.567147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:45.568648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:45.569777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e26f9da9-bea5-4280-8a55-dbc7b6a4a9c3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.102487 Nov 08 17:55:45.570326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 987/1985] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:45.628885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-22ef086b-0648-47d8-b30e-ced98dbfdd35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:45.636546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-22ef086b-0648-47d8-b30e-ced98dbfdd35 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.168945 Nov 08 17:55:45.637116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 999/1986] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:45 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:55:46.587643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:46.588230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:46.594681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:46.595126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:46.595894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:46.596327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:46.652949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1a19232e-55d7-443a-ae6c-bdd3d5e16263 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:46.654043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1a19232e-55d7-443a-ae6c-bdd3d5e16263 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:46.655854 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:46.659831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a19232e-55d7-443a-ae6c-bdd3d5e16263 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:46.660272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a19232e-55d7-443a-ae6c-bdd3d5e16263 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:46.661046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a19232e-55d7-443a-ae6c-bdd3d5e16263 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:46.661478 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1a19232e-55d7-443a-ae6c-bdd3d5e16263 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:46.664016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:46.665501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:46.666657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-50f84fe2-9ed6-422b-89b9-8e5ba55c6d72 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082703 Nov 08 17:55:46.667208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 988/1987] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:46.790512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1a19232e-55d7-443a-ae6c-bdd3d5e16263 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:46.798720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1a19232e-55d7-443a-ae6c-bdd3d5e16263 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149416 Nov 08 17:55:46.799282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1000/1988] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:46 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:55:47.683995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:47.684592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:47.691484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:47.691924 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:47.692690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:47.693116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:47.750774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:47.758809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:47.760267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:47.761379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d6cb747d-6abd-40b2-9265-399af58a459d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081092 Nov 08 17:55:47.761928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 989/1989] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:47.815748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-853ea447-b475-4a98-9a2c-6c77424293d5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:47.816350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-853ea447-b475-4a98-9a2c-6c77424293d5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:47.822563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-853ea447-b475-4a98-9a2c-6c77424293d5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:47.823006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-853ea447-b475-4a98-9a2c-6c77424293d5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:47.823775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-853ea447-b475-4a98-9a2c-6c77424293d5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:47.824205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-853ea447-b475-4a98-9a2c-6c77424293d5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:47.953836 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-853ea447-b475-4a98-9a2c-6c77424293d5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:47.961650 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-853ea447-b475-4a98-9a2c-6c77424293d5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149498 Nov 08 17:55:47.962210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1001/1990] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:47 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:48.780312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:48.781008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:48.787235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:48.787678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:48.788447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:48.788884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:48.850188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:48.859589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:48.861114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:48.862235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c72443e9-b518-41d0-8fe3-c9327a2232ca tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086156 Nov 08 17:55:48.862830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 990/1991] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:48.978683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8ffada37-8a33-433e-95b7-c4205fa8316c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:48.979552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8ffada37-8a33-433e-95b7-c4205fa8316c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:48.986637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ffada37-8a33-433e-95b7-c4205fa8316c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:48.987089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ffada37-8a33-433e-95b7-c4205fa8316c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:48.987871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ffada37-8a33-433e-95b7-c4205fa8316c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:48.988306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ffada37-8a33-433e-95b7-c4205fa8316c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:49.114449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8ffada37-8a33-433e-95b7-c4205fa8316c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:49.122136 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8ffada37-8a33-433e-95b7-c4205fa8316c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147303 Nov 08 17:55:49.122735 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1002/1992] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:48 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:49.880324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:49.880933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:49.887183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:49.890185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:49.890185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:49.890185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:49.947266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:49.955479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:49.957032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:49.958162 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0e7889a2-22da-43e6-bdd1-fa1d2388c6ed tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081631 Nov 08 17:55:49.958758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 991/1993] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:50.139312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b3ddb4b8-234f-454d-befd-0effbb48ff6e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:50.139846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b3ddb4b8-234f-454d-befd-0effbb48ff6e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:50.146000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3ddb4b8-234f-454d-befd-0effbb48ff6e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:50.146436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3ddb4b8-234f-454d-befd-0effbb48ff6e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:50.147224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3ddb4b8-234f-454d-befd-0effbb48ff6e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:50.147658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3ddb4b8-234f-454d-befd-0effbb48ff6e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:50.275415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b3ddb4b8-234f-454d-befd-0effbb48ff6e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:50.283771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b3ddb4b8-234f-454d-befd-0effbb48ff6e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148412 Nov 08 17:55:50.284333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1003/1994] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:50 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:50.976259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:50.976888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:50.983427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:50.983870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:50.984664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:50.985095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:51.044223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:51.052422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:51.053900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:51.055054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-588821ac-e233-4d3d-92e5-e3429e4ed496 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082534 Nov 08 17:55:51.055600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 992/1995] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:51.300327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-859ddcb7-684a-4a0d-be52-5cb208193d38 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:51.300938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-859ddcb7-684a-4a0d-be52-5cb208193d38 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:51.307209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-859ddcb7-684a-4a0d-be52-5cb208193d38 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:51.319146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-859ddcb7-684a-4a0d-be52-5cb208193d38 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:51.319146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-859ddcb7-684a-4a0d-be52-5cb208193d38 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:51.319146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-859ddcb7-684a-4a0d-be52-5cb208193d38 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:51.437582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-859ddcb7-684a-4a0d-be52-5cb208193d38 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:51.445480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-859ddcb7-684a-4a0d-be52-5cb208193d38 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148851 Nov 08 17:55:51.446055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1004/1996] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:51 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:52.073601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:52.074186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:52.080968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:52.081422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:52.082185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:52.082643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:52.140864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:52.148892 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:52.150372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:52.151528 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f10a685f-5320-47a5-ab35-4fb092db8847 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081730 Nov 08 17:55:52.152086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 993/1997] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:52.462801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c817ef01-4d1d-4df8-8379-3b8c65101e2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:52.463403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c817ef01-4d1d-4df8-8379-3b8c65101e2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:52.469547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c817ef01-4d1d-4df8-8379-3b8c65101e2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:52.469989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c817ef01-4d1d-4df8-8379-3b8c65101e2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:52.470790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c817ef01-4d1d-4df8-8379-3b8c65101e2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:52.471223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c817ef01-4d1d-4df8-8379-3b8c65101e2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:52.602588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c817ef01-4d1d-4df8-8379-3b8c65101e2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:52.610558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c817ef01-4d1d-4df8-8379-3b8c65101e2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151371 Nov 08 17:55:52.611125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1005/1998] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:52 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:53.169718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:53.171094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:53.177323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:53.177751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:53.178547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:53.178976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:53.237250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:53.245327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:53.246857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:53.248011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3059e9cc-1de5-4e6c-be43-ac4a58cd3420 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082042 Nov 08 17:55:53.248587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 994/1999] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:53.626200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-68039ec1-8a62-4626-90f4-27409bba58c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:53.626822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-68039ec1-8a62-4626-90f4-27409bba58c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:53.632960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68039ec1-8a62-4626-90f4-27409bba58c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:53.633395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68039ec1-8a62-4626-90f4-27409bba58c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:53.634165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68039ec1-8a62-4626-90f4-27409bba58c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:53.634618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-68039ec1-8a62-4626-90f4-27409bba58c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:53.769629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-68039ec1-8a62-4626-90f4-27409bba58c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:53.777261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-68039ec1-8a62-4626-90f4-27409bba58c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154788 Nov 08 17:55:53.777818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1006/2000] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:53 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:54.265651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:54.266201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:54.272376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:54.272818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:54.273581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:54.274008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:54.335223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:54.344016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:54.345505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:54.346673 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-99cc2545-4c41-4d18-802d-912d1e1a7914 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085456 Nov 08 17:55:54.347229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 995/2001] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:54.793992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dbe6b39a-7e0e-4092-aa63-0bd955c4d133 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:54.794635 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dbe6b39a-7e0e-4092-aa63-0bd955c4d133 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:54.801048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbe6b39a-7e0e-4092-aa63-0bd955c4d133 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:54.803705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbe6b39a-7e0e-4092-aa63-0bd955c4d133 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:54.803705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbe6b39a-7e0e-4092-aa63-0bd955c4d133 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:54.803705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbe6b39a-7e0e-4092-aa63-0bd955c4d133 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:54.930887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dbe6b39a-7e0e-4092-aa63-0bd955c4d133 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:54.939379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dbe6b39a-7e0e-4092-aa63-0bd955c4d133 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149004 Nov 08 17:55:54.939946 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1007/2002] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:54 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:55.365133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:55.365725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:55.371881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:55.372316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:55.377063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:55.377518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:55.435328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:55.443504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:55.444975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:55.446085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9cd68f8e-9b42-4911-9c19-a002f36461fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084713 Nov 08 17:55:55.446664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 996/2003] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:55.955923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cb4544a3-b5e9-454b-b5dc-364daeb302d9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:55.956530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cb4544a3-b5e9-454b-b5dc-364daeb302d9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:55.962752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb4544a3-b5e9-454b-b5dc-364daeb302d9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:55.963197 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb4544a3-b5e9-454b-b5dc-364daeb302d9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:55.963961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb4544a3-b5e9-454b-b5dc-364daeb302d9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:55.964398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb4544a3-b5e9-454b-b5dc-364daeb302d9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:56.093418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cb4544a3-b5e9-454b-b5dc-364daeb302d9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:56.101004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cb4544a3-b5e9-454b-b5dc-364daeb302d9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148733 Nov 08 17:55:56.101575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1008/2004] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:55 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:56.464250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:56.464886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:56.471931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:56.472374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:56.473139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:56.473573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:56.531723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:56.539685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:56.541194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:56.542300 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d0555f1a-6fd1-4673-885b-a1ec49c4c4a4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081780 Nov 08 17:55:56.542885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 997/2005] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:57.116884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bf24e913-5d18-4b00-9a73-3796a8fd2d5e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:57.117482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bf24e913-5d18-4b00-9a73-3796a8fd2d5e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:57.124227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf24e913-5d18-4b00-9a73-3796a8fd2d5e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:57.124817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf24e913-5d18-4b00-9a73-3796a8fd2d5e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:57.125578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf24e913-5d18-4b00-9a73-3796a8fd2d5e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:57.126002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bf24e913-5d18-4b00-9a73-3796a8fd2d5e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:57.253689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bf24e913-5d18-4b00-9a73-3796a8fd2d5e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:57.261316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bf24e913-5d18-4b00-9a73-3796a8fd2d5e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148128 Nov 08 17:55:57.261880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1009/2006] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:57 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:57.560814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:57.561964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:57.568223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:57.568666 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:57.569440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:57.569868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:57.628295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:57.636460 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:57.637948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:57.639225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b43535b1-1c06-47ea-9c2f-8c94dc49e308 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082087 Nov 08 17:55:57.639782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 998/2007] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:58.277892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4d47705b-9ddf-4f4d-a582-bc6fc59a15de tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:58.278438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4d47705b-9ddf-4f4d-a582-bc6fc59a15de tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:58.285275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4d47705b-9ddf-4f4d-a582-bc6fc59a15de tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:58.285711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4d47705b-9ddf-4f4d-a582-bc6fc59a15de tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:58.286480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4d47705b-9ddf-4f4d-a582-bc6fc59a15de tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:58.287025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4d47705b-9ddf-4f4d-a582-bc6fc59a15de tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:58.414559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4d47705b-9ddf-4f4d-a582-bc6fc59a15de tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:58.422403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4d47705b-9ddf-4f4d-a582-bc6fc59a15de tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148212 Nov 08 17:55:58.423064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1010/2008] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:58 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:58.656901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:58.657497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:58.663807 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:58.664245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:58.665003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:58.665432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:58.722931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:58.731336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:58.733380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:58.734518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-99148099-f965-4607-a78f-edcf587a9f03 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081385 Nov 08 17:55:58.735072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 999/2009] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:55:59.439117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-35765a2a-c35b-44f6-810a-3816741d8bd1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:59.439729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-35765a2a-c35b-44f6-810a-3816741d8bd1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:59.445941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-35765a2a-c35b-44f6-810a-3816741d8bd1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:59.446384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-35765a2a-c35b-44f6-810a-3816741d8bd1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:59.447187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-35765a2a-c35b-44f6-810a-3816741d8bd1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:59.447616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-35765a2a-c35b-44f6-810a-3816741d8bd1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:59.572391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-35765a2a-c35b-44f6-810a-3816741d8bd1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:59.580738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-35765a2a-c35b-44f6-810a-3816741d8bd1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145400 Nov 08 17:55:59.581298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1011/2010] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:55:59 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:55:59.752591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:55:59.753140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:55:59.759252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:59.759689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:59.760447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:55:59.760870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:55:59.821130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:59.829739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:59.831244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:55:59.832362 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d2e0510a-605f-4d86-b0fa-8f27233f25aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083586 Nov 08 17:55:59.832920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1000/2011] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:55:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:00.597523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fb8e162d-7dd6-4dec-9786-e73176d274db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:00.598124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fb8e162d-7dd6-4dec-9786-e73176d274db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:00.604635 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb8e162d-7dd6-4dec-9786-e73176d274db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:00.605075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb8e162d-7dd6-4dec-9786-e73176d274db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:00.605832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb8e162d-7dd6-4dec-9786-e73176d274db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:00.606259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb8e162d-7dd6-4dec-9786-e73176d274db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:00.731413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fb8e162d-7dd6-4dec-9786-e73176d274db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:00.739173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fb8e162d-7dd6-4dec-9786-e73176d274db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145260 Nov 08 17:56:00.739740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1012/2012] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:00 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:00.849889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:00.850543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:00.858116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:00.858785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:00.859560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:00.859994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:00.918188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:00.926350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:00.927866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:00.928986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8a2354bb-7dca-4799-8183-945f251aa57a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082769 Nov 08 17:56:00.929546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1001/2013] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:01.755704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c1cbb7fc-a43e-4cbf-8c57-7683f1b06818 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:01.756476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c1cbb7fc-a43e-4cbf-8c57-7683f1b06818 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:01.762866 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c1cbb7fc-a43e-4cbf-8c57-7683f1b06818 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:01.763391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c1cbb7fc-a43e-4cbf-8c57-7683f1b06818 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:01.764858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c1cbb7fc-a43e-4cbf-8c57-7683f1b06818 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:01.765409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c1cbb7fc-a43e-4cbf-8c57-7683f1b06818 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:01.899370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c1cbb7fc-a43e-4cbf-8c57-7683f1b06818 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:01.907739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c1cbb7fc-a43e-4cbf-8c57-7683f1b06818 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155654 Nov 08 17:56:01.908314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1013/2014] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:01 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:01.947234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:01.947819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:01.954709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:01.955152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:01.955911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:01.956338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:02.015245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:02.024669 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:02.026156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:02.027475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0d34f89f-2489-4ba1-90e8-306625b59057 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083953 Nov 08 17:56:02.028042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1002/2015] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:02.924840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-908f8f7d-fdee-4d23-9ccb-2a34e3c39b55 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:02.925440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-908f8f7d-fdee-4d23-9ccb-2a34e3c39b55 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:02.931632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908f8f7d-fdee-4d23-9ccb-2a34e3c39b55 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:02.932070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908f8f7d-fdee-4d23-9ccb-2a34e3c39b55 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:02.932824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908f8f7d-fdee-4d23-9ccb-2a34e3c39b55 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:02.933247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-908f8f7d-fdee-4d23-9ccb-2a34e3c39b55 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:03.055034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:03.055746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:03.060711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-908f8f7d-fdee-4d23-9ccb-2a34e3c39b55 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:03.062231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:03.062769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:03.063607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:03.064107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:03.068675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-908f8f7d-fdee-4d23-9ccb-2a34e3c39b55 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148103 Nov 08 17:56:03.069245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1014/2016] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:02 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:03.122519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:03.130771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:03.132269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:03.133387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f19322df-c1fb-4688-b7a0-aa3b728ab6d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082076 Nov 08 17:56:03.133941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1003/2017] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:04.085632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-190244b8-1a64-4066-b249-f2573d6b25b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:04.086223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-190244b8-1a64-4066-b249-f2573d6b25b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:04.093095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-190244b8-1a64-4066-b249-f2573d6b25b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:04.093547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-190244b8-1a64-4066-b249-f2573d6b25b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:04.094312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-190244b8-1a64-4066-b249-f2573d6b25b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:04.094764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-190244b8-1a64-4066-b249-f2573d6b25b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:04.151444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:04.152073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:04.159210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:04.159641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:04.160425 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:04.160859 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:04.229306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:04.237586 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:04.239104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:04.240234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-614a2b50-82c4-434b-bfa7-347a683bb6cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.092672 Nov 08 17:56:04.240788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1004/2018] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:04.249799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-190244b8-1a64-4066-b249-f2573d6b25b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:04.257363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-190244b8-1a64-4066-b249-f2573d6b25b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.175526 Nov 08 17:56:04.262204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1015/2019] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:04 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:05.258214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:05.258851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:05.265132 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:05.265575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:05.266341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:05.266807 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:05.276766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-19355b68-0f28-49f3-8dea-40f196dd2b0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:05.277364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-19355b68-0f28-49f3-8dea-40f196dd2b0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:05.284525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19355b68-0f28-49f3-8dea-40f196dd2b0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:05.284961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19355b68-0f28-49f3-8dea-40f196dd2b0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:05.285721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19355b68-0f28-49f3-8dea-40f196dd2b0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:05.286359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19355b68-0f28-49f3-8dea-40f196dd2b0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:05.326889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:05.335277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:05.336761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:05.337894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-57461dbd-ddca-49bf-ac12-c53dedf35cba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083384 Nov 08 17:56:05.338537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1005/2020] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:05.421680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-19355b68-0f28-49f3-8dea-40f196dd2b0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:05.429388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-19355b68-0f28-49f3-8dea-40f196dd2b0e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.156243 Nov 08 17:56:05.429960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1016/2021] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:05 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:06.355969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:06.356565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:06.363713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:06.364152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:06.364914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:06.365341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:06.423925 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:06.431959 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:06.433434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:06.434582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ea240e42-8462-4354-9b6f-e842062c2bfd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082639 Nov 08 17:56:06.435229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1006/2022] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:06.445943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ea823f7e-e700-4632-ac17-72d0ba7d3ced tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:06.446579 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ea823f7e-e700-4632-ac17-72d0ba7d3ced tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:06.453019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea823f7e-e700-4632-ac17-72d0ba7d3ced tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:06.453458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea823f7e-e700-4632-ac17-72d0ba7d3ced tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:06.454223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea823f7e-e700-4632-ac17-72d0ba7d3ced tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:06.454696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea823f7e-e700-4632-ac17-72d0ba7d3ced tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:06.581131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ea823f7e-e700-4632-ac17-72d0ba7d3ced tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:06.588748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ea823f7e-e700-4632-ac17-72d0ba7d3ced tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146447 Nov 08 17:56:06.589304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1017/2023] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:06 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:07.453910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:07.454539 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:07.460721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:07.461161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:07.461918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:07.462347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:07.520439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:07.528418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:07.529945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:07.531094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bd4fc53c-1c2b-419a-bdb8-aa239981c28e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081901 Nov 08 17:56:07.531638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1007/2024] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:07.606352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dfabcb3f-8419-4062-b0cd-e7fdb411c971 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:07.606977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dfabcb3f-8419-4062-b0cd-e7fdb411c971 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:07.613131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dfabcb3f-8419-4062-b0cd-e7fdb411c971 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:07.613566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dfabcb3f-8419-4062-b0cd-e7fdb411c971 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:07.614324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dfabcb3f-8419-4062-b0cd-e7fdb411c971 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:07.614774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dfabcb3f-8419-4062-b0cd-e7fdb411c971 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:07.743341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dfabcb3f-8419-4062-b0cd-e7fdb411c971 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:07.751511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dfabcb3f-8419-4062-b0cd-e7fdb411c971 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149030 Nov 08 17:56:07.752077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1018/2025] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:07 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:08.548813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:08.549398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:08.555695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:08.556141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:08.556910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:08.557339 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:08.616793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:08.624892 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:08.626388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:08.627543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7bbe3101-f061-45ae-a083-4aff52415aa0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082453 Nov 08 17:56:08.628097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1008/2026] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:08.769111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d490c84a-0d6b-4dd0-9e8f-d9db89aeab07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:08.769747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d490c84a-0d6b-4dd0-9e8f-d9db89aeab07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:08.775986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d490c84a-0d6b-4dd0-9e8f-d9db89aeab07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:08.776458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d490c84a-0d6b-4dd0-9e8f-d9db89aeab07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:08.777219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d490c84a-0d6b-4dd0-9e8f-d9db89aeab07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:08.777649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d490c84a-0d6b-4dd0-9e8f-d9db89aeab07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:08.903446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d490c84a-0d6b-4dd0-9e8f-d9db89aeab07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:08.911631 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d490c84a-0d6b-4dd0-9e8f-d9db89aeab07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146294 Nov 08 17:56:08.912203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1019/2027] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:08 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:09.645676 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:09.646293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:09.652491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:09.652929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:09.653684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:09.654108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:09.715328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:09.723587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:09.725072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:09.726192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-03536f23-96cd-46c0-b5c1-1474f0ab8d0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084173 Nov 08 17:56:09.726787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1009/2028] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:09.929379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e327da80-0264-4b5e-9447-b99dc8f66a2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:09.929913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e327da80-0264-4b5e-9447-b99dc8f66a2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:09.936626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e327da80-0264-4b5e-9447-b99dc8f66a2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:09.937274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e327da80-0264-4b5e-9447-b99dc8f66a2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:09.938055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e327da80-0264-4b5e-9447-b99dc8f66a2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:09.938504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e327da80-0264-4b5e-9447-b99dc8f66a2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:10.064731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e327da80-0264-4b5e-9447-b99dc8f66a2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:10.072427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e327da80-0264-4b5e-9447-b99dc8f66a2e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146748 Nov 08 17:56:10.072989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1020/2029] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:09 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:10.744379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:10.744962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:10.751582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:10.752026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:10.752801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:10.753232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:10.772443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ac25e45b-61ad-45a4-ada9-094b7631c014 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:10.772953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ac25e45b-61ad-45a4-ada9-094b7631c014 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:10.778685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac25e45b-61ad-45a4-ada9-094b7631c014 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:10.779125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac25e45b-61ad-45a4-ada9-094b7631c014 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:10.779977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac25e45b-61ad-45a4-ada9-094b7631c014 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:10.780954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ac25e45b-61ad-45a4-ada9-094b7631c014 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:10.804284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ac25e45b-61ad-45a4-ada9-094b7631c014 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 17:56:10.812994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:10.821145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:10.822653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:10.823769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-194b0951-ed93-4491-ab53-e595e83cd190 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083147 Nov 08 17:56:10.824318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1010/2030] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:11.088944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d2fabf3b-1902-436b-bc3d-6fcf44c8b08a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:11.089445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d2fabf3b-1902-436b-bc3d-6fcf44c8b08a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:11.095723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2fabf3b-1902-436b-bc3d-6fcf44c8b08a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:11.096169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2fabf3b-1902-436b-bc3d-6fcf44c8b08a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:11.096945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2fabf3b-1902-436b-bc3d-6fcf44c8b08a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:11.097378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2fabf3b-1902-436b-bc3d-6fcf44c8b08a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:11.118607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ac25e45b-61ad-45a4-ada9-094b7631c014 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 204 len: 0 microversion: 2.1 time: 0.349497 Nov 08 17:56:11.119279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1021/2031] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:56:10 2021] DELETE /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 08 17:56:11.128210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-17b61ac7-68fd-4f6f-8860-7f4337646abd tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:11.130144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-17b61ac7-68fd-4f6f-8860-7f4337646abd tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:11.135595 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17b61ac7-68fd-4f6f-8860-7f4337646abd tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:11.136077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17b61ac7-68fd-4f6f-8860-7f4337646abd tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:11.136852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17b61ac7-68fd-4f6f-8860-7f4337646abd tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:11.137277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17b61ac7-68fd-4f6f-8860-7f4337646abd tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:11.268360 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d2fabf3b-1902-436b-bc3d-6fcf44c8b08a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:11.276253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d2fabf3b-1902-436b-bc3d-6fcf44c8b08a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.191133 Nov 08 17:56:11.276836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1011/2032] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:11 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:11.309144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-17b61ac7-68fd-4f6f-8860-7f4337646abd tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:11.317182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-17b61ac7-68fd-4f6f-8860-7f4337646abd tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1552 microversion: 2.1 time: 0.193533 Nov 08 17:56:11.317761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1022/2033] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:11 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:11.843302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:11.843912 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:11.850368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:11.850836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:11.851605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:11.852075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:11.915399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:11.923706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:11.925327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:11.926481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-df1ae121-cc9a-43bb-a09b-f9c361239203 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.088259 Nov 08 17:56:11.927108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1012/2034] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:12.292979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c50b6dc3-0ff9-46ee-958c-cec351fd8572 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:12.293616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c50b6dc3-0ff9-46ee-958c-cec351fd8572 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:12.300461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c50b6dc3-0ff9-46ee-958c-cec351fd8572 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:12.300904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c50b6dc3-0ff9-46ee-958c-cec351fd8572 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:12.301672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c50b6dc3-0ff9-46ee-958c-cec351fd8572 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:12.302098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c50b6dc3-0ff9-46ee-958c-cec351fd8572 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:12.336573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-75dfeafb-23b9-408a-ad3a-9d6251d28d8f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:12.337317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-75dfeafb-23b9-408a-ad3a-9d6251d28d8f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:12.343461 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75dfeafb-23b9-408a-ad3a-9d6251d28d8f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:12.343938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75dfeafb-23b9-408a-ad3a-9d6251d28d8f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:12.344720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75dfeafb-23b9-408a-ad3a-9d6251d28d8f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:12.345156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75dfeafb-23b9-408a-ad3a-9d6251d28d8f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:12.464250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c50b6dc3-0ff9-46ee-958c-cec351fd8572 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:12.472303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c50b6dc3-0ff9-46ee-958c-cec351fd8572 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.183036 Nov 08 17:56:12.473073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1023/2035] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:12 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:12.507090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-75dfeafb-23b9-408a-ad3a-9d6251d28d8f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:12.514306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-75dfeafb-23b9-408a-ad3a-9d6251d28d8f tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1552 microversion: 2.1 time: 0.181307 Nov 08 17:56:12.515043 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1013/2036] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:12 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:12.945448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:12.946056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:12.954450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:12.954923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:12.955817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:12.956245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:13.020387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:13.029107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:13.032091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:13.032091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f99114b7-a3e4-4f56-9036-845c4d441f35 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.090237 Nov 08 17:56:13.032467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1024/2037] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:13.037506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-d97ab1d1-b6e3-45a0-96f6-321670fa8c93 req-6b85dc72-be1b-4d6d-add1-c96871a706af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e71a891-29d7-4c17-822f-5d7ffec95227", "name": "network-vif-deleted", "tag": "63f51964-3a06-45fc-8853-d2c8cd7884a9"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:56:13.039101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 17:56:13.039101 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 17:56:13.046552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-d97ab1d1-b6e3-45a0-96f6-321670fa8c93 req-6b85dc72-be1b-4d6d-add1-c96871a706af service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:13.047131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-d97ab1d1-b6e3-45a0-96f6-321670fa8c93 req-6b85dc72-be1b-4d6d-add1-c96871a706af service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:13.057699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-d97ab1d1-b6e3-45a0-96f6-321670fa8c93 req-6b85dc72-be1b-4d6d-add1-c96871a706af service nova] Creating event network-vif-deleted:63f51964-3a06-45fc-8853-d2c8cd7884a9 for instance 3e71a891-29d7-4c17-822f-5d7ffec95227 on hv-cinder-81689 Nov 08 17:56:13.063565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-d97ab1d1-b6e3-45a0-96f6-321670fa8c93 req-6b85dc72-be1b-4d6d-add1-c96871a706af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029712 Nov 08 17:56:13.064140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1014/2038] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 17:56:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 17:56:13.489204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e4267096-bd62-49dd-944b-9b8b3ce42812 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:13.489814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e4267096-bd62-49dd-944b-9b8b3ce42812 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:13.496034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e4267096-bd62-49dd-944b-9b8b3ce42812 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:13.496480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e4267096-bd62-49dd-944b-9b8b3ce42812 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:13.497245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e4267096-bd62-49dd-944b-9b8b3ce42812 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:13.497680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e4267096-bd62-49dd-944b-9b8b3ce42812 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:13.532562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:13.533250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:13.540032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:13.540956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:13.541394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:13.541837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:13.572561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:13.572929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:13.573389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lazy-loading 'fault' on Instance uuid 3e71a891-29d7-4c17-822f-5d7ffec95227 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 17:56:13.883715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81b2d96645d409a8ee24c22b0a38212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ace5aeb13f14cd4a8df4694a033b9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:13.890903 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ec71c73a-c457-4442-8a87-035145696991 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 200 len: 1347 microversion: 2.1 time: 0.362853 Nov 08 17:56:13.891675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1015/2039] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:13 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 1347 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:13.911501 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e4267096-bd62-49dd-944b-9b8b3ce42812 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:13.919223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e4267096-bd62-49dd-944b-9b8b3ce42812 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.433723 Nov 08 17:56:13.919783 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1025/2040] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:13 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:14.049070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:14.049667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:14.055850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:14.056313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:14.057059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:14.057489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:14.115472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:14.124078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:14.125566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:14.126727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8454b9df-e4e3-486b-903f-3ba00e1fb2fa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081520 Nov 08 17:56:14.127278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1016/2041] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:14.908726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:14.909341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] [instance: 3e71a891-29d7-4c17-822f-5d7ffec95227] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:14.915198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:14.915649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:14.916408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:14.916840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:14.930127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] HTTP exception thrown: Instance 3e71a891-29d7-4c17-822f-5d7ffec95227 could not be found. Nov 08 17:56:14.930733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Returning 404 to user: Instance 3e71a891-29d7-4c17-822f-5d7ffec95227 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:56:14.931552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f7140796-19f9-4597-8c04-6119e3435416 tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227" status: 404 len: 111 microversion: 2.1 time: 0.027299 Nov 08 17:56:14.932076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1026/2042] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:14 2021] GET /compute/v2.1/servers/3e71a891-29d7-4c17-822f-5d7ffec95227 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:56:14.935754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-60e06368-8ec6-40a4-920d-6b0438c8019a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:14.936573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-60e06368-8ec6-40a4-920d-6b0438c8019a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:14.939437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d96f13d7-1998-4465-8371-cb774c80f90d tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] Calling method '.version_select at 0x7f06ec1f80d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:14.942581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-60e06368-8ec6-40a4-920d-6b0438c8019a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:14.943022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-60e06368-8ec6-40a4-920d-6b0438c8019a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:14.943795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-60e06368-8ec6-40a4-920d-6b0438c8019a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:14.944218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-60e06368-8ec6-40a4-920d-6b0438c8019a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:15.005589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d96f13d7-1998-4465-8371-cb774c80f90d tempest-TestMinimumBasicScenario-1425771917 tempest-TestMinimumBasicScenario-1425771917-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-856997796" status: 202 len: 0 microversion: 2.1 time: 0.069429 Nov 08 17:56:15.006940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1027/2043] 10.222.0.18 () {58 vars in 1268 bytes} [Mon Nov 8 17:56:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-856997796 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 17:56:15.076776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-60e06368-8ec6-40a4-920d-6b0438c8019a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:15.084527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-60e06368-8ec6-40a4-920d-6b0438c8019a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152537 Nov 08 17:56:15.085092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1017/2044] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:14 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:15.147694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:15.148575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:15.154250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:15.155213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:15.156113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:15.157054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:15.220000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:15.228384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:15.230057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:15.235845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-aefcf999-e711-4ddb-9d77-903d3466157f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087201 Nov 08 17:56:15.235845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1028/2045] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:16.100953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-600ecd9c-7fae-4697-a5aa-af4991e569f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:16.101516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-600ecd9c-7fae-4697-a5aa-af4991e569f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:16.108566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-600ecd9c-7fae-4697-a5aa-af4991e569f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:16.109078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-600ecd9c-7fae-4697-a5aa-af4991e569f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:16.109878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-600ecd9c-7fae-4697-a5aa-af4991e569f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:16.110312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-600ecd9c-7fae-4697-a5aa-af4991e569f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:16.249036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:16.249662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:16.256039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:16.256487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:16.257269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:16.257704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:16.297349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-600ecd9c-7fae-4697-a5aa-af4991e569f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:16.304983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-600ecd9c-7fae-4697-a5aa-af4991e569f4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.207778 Nov 08 17:56:16.305680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1018/2046] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:16 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:16.329482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:16.337819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:16.339422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:16.340554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-43c808a6-d3c0-47b1-a807-0532aa97acd8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.095346 Nov 08 17:56:16.341127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1029/2047] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:17.323045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-eb9bdd61-20b8-43ce-bde8-502469c2d841 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:17.323624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-eb9bdd61-20b8-43ce-bde8-502469c2d841 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:17.330297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eb9bdd61-20b8-43ce-bde8-502469c2d841 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:17.330859 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eb9bdd61-20b8-43ce-bde8-502469c2d841 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:17.331653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eb9bdd61-20b8-43ce-bde8-502469c2d841 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:17.332078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eb9bdd61-20b8-43ce-bde8-502469c2d841 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:17.359883 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:17.360473 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:17.367493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:17.367931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:17.368699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:17.369387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:17.448207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:17.457023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:17.458527 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:17.459645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cfd282da-6559-44c5-917e-7148fbc2eafd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.104226 Nov 08 17:56:17.460205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1030/2048] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:17.595515 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-eb9bdd61-20b8-43ce-bde8-502469c2d841 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:17.604074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-eb9bdd61-20b8-43ce-bde8-502469c2d841 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.284742 Nov 08 17:56:17.605242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1019/2049] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:17 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:18.478952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:18.479495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:18.486099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:18.486695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:18.487587 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:18.488046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:18.549788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:18.558824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:18.560339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:18.562095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-eeede9bf-e44a-412c-b242-03e2bf79de8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087279 Nov 08 17:56:18.573092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1031/2050] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:18.621199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ebae297f-1ffc-4f29-a76d-81f32f84a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:18.622001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ebae297f-1ffc-4f29-a76d-81f32f84a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:18.629309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebae297f-1ffc-4f29-a76d-81f32f84a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:18.629762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebae297f-1ffc-4f29-a76d-81f32f84a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:18.630711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebae297f-1ffc-4f29-a76d-81f32f84a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:18.631141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebae297f-1ffc-4f29-a76d-81f32f84a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:18.846022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ebae297f-1ffc-4f29-a76d-81f32f84a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:18.854260 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ebae297f-1ffc-4f29-a76d-81f32f84a733 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.236882 Nov 08 17:56:18.854915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1020/2051] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:18 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:19.581219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:19.581826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:19.588360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:19.588823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:19.589630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:19.590059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:19.649010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:19.657824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:19.659335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:19.660471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-789b3bdf-db7a-4eb7-9b90-52a5d8509843 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083730 Nov 08 17:56:19.661034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1032/2052] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:19.972619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4b1c1f54-7ad3-447d-99de-809e511a1f6a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:19.972619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4b1c1f54-7ad3-447d-99de-809e511a1f6a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:19.977080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b1c1f54-7ad3-447d-99de-809e511a1f6a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:19.977526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b1c1f54-7ad3-447d-99de-809e511a1f6a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:19.978298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b1c1f54-7ad3-447d-99de-809e511a1f6a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:19.979030 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b1c1f54-7ad3-447d-99de-809e511a1f6a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:20.448300 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4b1c1f54-7ad3-447d-99de-809e511a1f6a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:20.456536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4b1c1f54-7ad3-447d-99de-809e511a1f6a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.589068 Nov 08 17:56:20.457102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1021/2053] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:19 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:20.678694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:20.679263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:20.685404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:20.685874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:20.686701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:20.687130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:20.760893 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:20.769758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:20.771493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:20.772670 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-04955981-9d0e-420c-8b73-98c997227ad2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.097817 Nov 08 17:56:20.773229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1033/2054] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:21.472541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e4b16f91-53c2-480b-8b47-e62801584c00 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:21.473084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e4b16f91-53c2-480b-8b47-e62801584c00 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:21.479615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4b16f91-53c2-480b-8b47-e62801584c00 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:21.480056 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4b16f91-53c2-480b-8b47-e62801584c00 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:21.480818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4b16f91-53c2-480b-8b47-e62801584c00 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:21.481240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4b16f91-53c2-480b-8b47-e62801584c00 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:21.691184 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e4b16f91-53c2-480b-8b47-e62801584c00 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:21.700031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e4b16f91-53c2-480b-8b47-e62801584c00 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.231293 Nov 08 17:56:21.700854 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1022/2055] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:21 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:21.791349 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:21.792508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:21.799917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:21.800733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:21.801736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:21.802388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:21.867554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:21.876329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:21.877813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:21.879011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-79b9eda9-f068-4768-8aed-c2f1a256ddea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.091326 Nov 08 17:56:21.884613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1034/2056] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:22.716968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5dcd53c9-8a42-4027-a0ae-03d2c7ca0fe2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:22.718423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5dcd53c9-8a42-4027-a0ae-03d2c7ca0fe2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:22.724875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dcd53c9-8a42-4027-a0ae-03d2c7ca0fe2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:22.725322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dcd53c9-8a42-4027-a0ae-03d2c7ca0fe2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:22.726103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dcd53c9-8a42-4027-a0ae-03d2c7ca0fe2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:22.726661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5dcd53c9-8a42-4027-a0ae-03d2c7ca0fe2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:22.857805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5dcd53c9-8a42-4027-a0ae-03d2c7ca0fe2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:22.868899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5dcd53c9-8a42-4027-a0ae-03d2c7ca0fe2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152532 Nov 08 17:56:22.868899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1023/2057] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:22 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:22.896924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:22.897514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:22.903717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:22.904368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:22.905539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:22.905905 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:22.976179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:22.981519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:22.983121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:22.984214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7ab59543-3df9-45b4-bb83-17c28c89b99f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.091024 Nov 08 17:56:22.984761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1035/2058] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:23.883843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-352c2d16-e98b-437d-87a0-46c6436b9a5f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:23.884510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-352c2d16-e98b-437d-87a0-46c6436b9a5f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:23.891137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-352c2d16-e98b-437d-87a0-46c6436b9a5f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:23.891769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-352c2d16-e98b-437d-87a0-46c6436b9a5f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:23.892744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-352c2d16-e98b-437d-87a0-46c6436b9a5f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:23.893329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-352c2d16-e98b-437d-87a0-46c6436b9a5f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:24.004648 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:24.005860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:24.012039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:24.012484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:24.013255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:24.013690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:24.031535 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-352c2d16-e98b-437d-87a0-46c6436b9a5f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:24.039491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-352c2d16-e98b-437d-87a0-46c6436b9a5f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.160072 Nov 08 17:56:24.040051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1024/2059] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:23 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:24.072700 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:24.080745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:24.082236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:24.083388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6d644bdb-b504-47fd-928e-e067018db619 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082572 Nov 08 17:56:24.083946 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1036/2060] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:25.056802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ea6b6e20-3ee9-4be5-a26f-425b5bdc7f13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:25.057414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ea6b6e20-3ee9-4be5-a26f-425b5bdc7f13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:25.064342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea6b6e20-3ee9-4be5-a26f-425b5bdc7f13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:25.064785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea6b6e20-3ee9-4be5-a26f-425b5bdc7f13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:25.065563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea6b6e20-3ee9-4be5-a26f-425b5bdc7f13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:25.065995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea6b6e20-3ee9-4be5-a26f-425b5bdc7f13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:25.100895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:25.101534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:25.108318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:25.109343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:25.110183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:25.110660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:25.184460 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:25.196242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:25.196242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:25.196615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a68db431-4ccd-48d6-9799-c88325d0ab41 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.099392 Nov 08 17:56:25.201754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1037/2061] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:25.237604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea6b6e20-3ee9-4be5-a26f-425b5bdc7f13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:25.245528 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ea6b6e20-3ee9-4be5-a26f-425b5bdc7f13 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.192358 Nov 08 17:56:25.246114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1025/2062] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:25 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:26.228647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:26.229196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:26.235717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:26.236163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:26.236943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:26.237374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:26.263443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9af545af-cdbd-4c78-8610-a3f884c7607f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:26.264134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9af545af-cdbd-4c78-8610-a3f884c7607f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:26.271187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9af545af-cdbd-4c78-8610-a3f884c7607f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:26.271630 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9af545af-cdbd-4c78-8610-a3f884c7607f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:26.272657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9af545af-cdbd-4c78-8610-a3f884c7607f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:26.273123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9af545af-cdbd-4c78-8610-a3f884c7607f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:26.312424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:26.321082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:26.322619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:26.323745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ff3d6c03-25d5-402b-a096-1ab942098130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.099199 Nov 08 17:56:26.324299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1038/2063] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:26.429337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9af545af-cdbd-4c78-8610-a3f884c7607f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:26.437620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9af545af-cdbd-4c78-8610-a3f884c7607f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.177551 Nov 08 17:56:26.438243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1026/2064] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:26 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:27.343691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:27.344282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:27.350616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:27.351058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:27.351818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:27.352244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:27.418072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:27.426361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:27.428103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:27.429201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b850c0b5-b6f2-42e5-829a-c4e86151c7d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.089819 Nov 08 17:56:27.429756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1039/2065] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:27.454623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b9a4a742-3815-43e2-8a5a-5827abdf3703 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:27.455206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b9a4a742-3815-43e2-8a5a-5827abdf3703 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:27.461640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9a4a742-3815-43e2-8a5a-5827abdf3703 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:27.462091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9a4a742-3815-43e2-8a5a-5827abdf3703 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:27.462988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9a4a742-3815-43e2-8a5a-5827abdf3703 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:27.463430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b9a4a742-3815-43e2-8a5a-5827abdf3703 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:27.607664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b9a4a742-3815-43e2-8a5a-5827abdf3703 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:27.615395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b9a4a742-3815-43e2-8a5a-5827abdf3703 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.165509 Nov 08 17:56:27.615962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1027/2066] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:27 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:28.448015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:28.448804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:28.456418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:28.457288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:28.458335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:28.459196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:28.544663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:28.554429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:28.555960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:28.566773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0d475d30-b7ca-45ce-868c-82b84e9e1dc0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.112971 Nov 08 17:56:28.566773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1040/2067] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:28.633334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c994e4ce-bd72-4297-85bb-b29969e30d15 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:28.634081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c994e4ce-bd72-4297-85bb-b29969e30d15 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:28.640978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c994e4ce-bd72-4297-85bb-b29969e30d15 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:28.641677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c994e4ce-bd72-4297-85bb-b29969e30d15 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:28.642762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c994e4ce-bd72-4297-85bb-b29969e30d15 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:28.643197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c994e4ce-bd72-4297-85bb-b29969e30d15 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:28.951082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c994e4ce-bd72-4297-85bb-b29969e30d15 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:28.959906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c994e4ce-bd72-4297-85bb-b29969e30d15 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.330566 Nov 08 17:56:28.965770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1028/2068] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:28 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:29.575859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:29.576474 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:29.583122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:29.583672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:29.584535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:29.585201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:29.718276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:29.727472 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:29.729285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:29.730422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-58df3873-f535-465d-979f-1acce548e983 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.158458 Nov 08 17:56:29.731003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1041/2069] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:29.978137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-48d38856-7da3-4ac8-b833-2209f39fe10c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:29.979040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-48d38856-7da3-4ac8-b833-2209f39fe10c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:29.986284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-48d38856-7da3-4ac8-b833-2209f39fe10c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:29.990602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-48d38856-7da3-4ac8-b833-2209f39fe10c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:29.990602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-48d38856-7da3-4ac8-b833-2209f39fe10c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:29.990602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-48d38856-7da3-4ac8-b833-2209f39fe10c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:30.195036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-48d38856-7da3-4ac8-b833-2209f39fe10c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:30.204074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-48d38856-7da3-4ac8-b833-2209f39fe10c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.229406 Nov 08 17:56:30.204901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1029/2070] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:29 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:30.748925 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:30.750367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:30.756759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:30.757283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:30.758327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:30.758983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:30.828195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:30.836327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:30.837817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:30.838976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-12bc7ced-057a-46a0-b3a6-c01b56a7cdf3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.093778 Nov 08 17:56:30.839537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1042/2071] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:31.221001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-90c0864f-62fa-4dec-be2f-1d43aa99fb7e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:31.221715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-90c0864f-62fa-4dec-be2f-1d43aa99fb7e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:31.228121 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90c0864f-62fa-4dec-be2f-1d43aa99fb7e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:31.228819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90c0864f-62fa-4dec-be2f-1d43aa99fb7e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:31.229789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90c0864f-62fa-4dec-be2f-1d43aa99fb7e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:31.230399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90c0864f-62fa-4dec-be2f-1d43aa99fb7e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:31.473261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-90c0864f-62fa-4dec-be2f-1d43aa99fb7e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:31.481740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-90c0864f-62fa-4dec-be2f-1d43aa99fb7e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.265064 Nov 08 17:56:31.482307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1030/2072] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:31 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:31.857500 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:31.858143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:31.867521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:31.868251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:31.869201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:31.869792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:31.966584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:31.975369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:31.976952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:31.978150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a8d5e0a2-a6ac-43fc-a504-3c40bdb4b654 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.124774 Nov 08 17:56:31.979090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1043/2073] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:32.498738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6f8e5e9e-788d-47a9-bb84-430e4148ec49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:32.499514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6f8e5e9e-788d-47a9-bb84-430e4148ec49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:32.505899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f8e5e9e-788d-47a9-bb84-430e4148ec49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:32.506336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f8e5e9e-788d-47a9-bb84-430e4148ec49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:32.507142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f8e5e9e-788d-47a9-bb84-430e4148ec49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:32.510035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f8e5e9e-788d-47a9-bb84-430e4148ec49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:32.649358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6f8e5e9e-788d-47a9-bb84-430e4148ec49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:32.657714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6f8e5e9e-788d-47a9-bb84-430e4148ec49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.162630 Nov 08 17:56:32.658502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1031/2074] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:32 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:32.998626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:33.000373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:33.007642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:33.008095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:33.008883 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:33.010439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:33.098129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:33.110455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:33.110455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:33.113436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8a158d65-dcfb-4946-aee5-2b30934741b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.120034 Nov 08 17:56:33.124566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1044/2075] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:33.675710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a57631c2-cdb3-4a23-9fa5-baf0dfc25014 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:33.676407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a57631c2-cdb3-4a23-9fa5-baf0dfc25014 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:33.682710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a57631c2-cdb3-4a23-9fa5-baf0dfc25014 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:33.683498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a57631c2-cdb3-4a23-9fa5-baf0dfc25014 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:33.684278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a57631c2-cdb3-4a23-9fa5-baf0dfc25014 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:33.684711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a57631c2-cdb3-4a23-9fa5-baf0dfc25014 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:33.867297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a57631c2-cdb3-4a23-9fa5-baf0dfc25014 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:33.875428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a57631c2-cdb3-4a23-9fa5-baf0dfc25014 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.204057 Nov 08 17:56:33.876286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1032/2076] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:33 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:34.131784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:34.132388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:34.138907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:34.146675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:34.146675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:34.146675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:34.206677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:34.216164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:34.217467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:34.219189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a63dc82e-4a90-4c77-842a-5e1bd7ee47c6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.090762 Nov 08 17:56:34.219958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1045/2077] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:34.892940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bc2b98e2-c533-4251-8dd4-32c5eb9e4d5b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:34.897297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bc2b98e2-c533-4251-8dd4-32c5eb9e4d5b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:34.903273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc2b98e2-c533-4251-8dd4-32c5eb9e4d5b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:34.903720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc2b98e2-c533-4251-8dd4-32c5eb9e4d5b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:34.904821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc2b98e2-c533-4251-8dd4-32c5eb9e4d5b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:34.904947 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bc2b98e2-c533-4251-8dd4-32c5eb9e4d5b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:35.142424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bc2b98e2-c533-4251-8dd4-32c5eb9e4d5b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:35.153381 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bc2b98e2-c533-4251-8dd4-32c5eb9e4d5b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.264316 Nov 08 17:56:35.154056 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1033/2078] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:34 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:35.237122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:35.237888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:35.244771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:35.245602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:35.246662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:35.247363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:35.385869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:35.397659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:35.399549 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:35.401910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ca39f3d8-beeb-475f-bddd-72b995ef09b0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.168127 Nov 08 17:56:35.403633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1046/2079] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:36.170878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4b216283-16a6-455a-adf5-ad044027c8ff tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:36.173030 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4b216283-16a6-455a-adf5-ad044027c8ff tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:36.180408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b216283-16a6-455a-adf5-ad044027c8ff tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:36.180934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b216283-16a6-455a-adf5-ad044027c8ff tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:36.181819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b216283-16a6-455a-adf5-ad044027c8ff tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:36.182682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4b216283-16a6-455a-adf5-ad044027c8ff tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:36.420260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:36.420864 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:36.428923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:36.429371 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:36.430837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:36.430837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:36.511856 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:36.521383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:36.523390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:36.524787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-36b5f8d9-bb9c-40b6-bc93-872bbe554101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.108210 Nov 08 17:56:36.525537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1047/2080] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:36.570434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4b216283-16a6-455a-adf5-ad044027c8ff tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:36.581945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4b216283-16a6-455a-adf5-ad044027c8ff tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.414890 Nov 08 17:56:36.584962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1034/2081] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:36 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:37.543546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:37.544846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:37.552054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:37.553496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:37.554789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:37.557590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:37.600527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-85476428-1942-42fb-8d33-19f6cc8b0503 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:37.607281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-85476428-1942-42fb-8d33-19f6cc8b0503 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:37.616525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85476428-1942-42fb-8d33-19f6cc8b0503 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:37.617321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85476428-1942-42fb-8d33-19f6cc8b0503 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:37.619121 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85476428-1942-42fb-8d33-19f6cc8b0503 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:37.619784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85476428-1942-42fb-8d33-19f6cc8b0503 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:37.646914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:37.670938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:37.679369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:37.680563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-60d31df5-2f6c-40d1-8d0f-f3677e7ee95e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.140715 Nov 08 17:56:37.681469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1048/2082] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:37.781938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-85476428-1942-42fb-8d33-19f6cc8b0503 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:37.789938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-85476428-1942-42fb-8d33-19f6cc8b0503 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.193142 Nov 08 17:56:37.790614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1035/2083] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:37 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:38.697781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:38.698414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:38.704967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:38.705400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:38.706579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:38.707082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:38.770484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:38.778033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-29ed8243-75de-4e5b-b708-961cfa7cbf88 tempest-TestVolumeBootPattern-1590194854 tempest-TestVolumeBootPattern-1590194854-project] Action: 'create', calling method: .version_select at 0x7f06f0662dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2130527841"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 17:56:38.779129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:38.780615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:38.782340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bb9122cf-e67d-49dd-b94b-827f4082ae60 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.088321 Nov 08 17:56:38.782926 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1036/2084] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:38.792772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-29ed8243-75de-4e5b-b708-961cfa7cbf88 tempest-TestVolumeBootPattern-1590194854 tempest-TestVolumeBootPattern-1590194854-project] Getting quotas for project 549e37f0b044475983a7752fee77154b. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:56:38.796612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-29ed8243-75de-4e5b-b708-961cfa7cbf88 tempest-TestVolumeBootPattern-1590194854 tempest-TestVolumeBootPattern-1590194854-project] Getting quotas for user 385cd5d368df40b282de4e821a7bda0f and project 549e37f0b044475983a7752fee77154b. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:56:38.806821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8188c857-91dc-4f1a-b8b7-ccc63347cd6f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:38.807531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8188c857-91dc-4f1a-b8b7-ccc63347cd6f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:38.813307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8188c857-91dc-4f1a-b8b7-ccc63347cd6f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:38.813741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8188c857-91dc-4f1a-b8b7-ccc63347cd6f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:38.814522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8188c857-91dc-4f1a-b8b7-ccc63347cd6f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:38.814948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8188c857-91dc-4f1a-b8b7-ccc63347cd6f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:38.951365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8188c857-91dc-4f1a-b8b7-ccc63347cd6f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:38.966661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8188c857-91dc-4f1a-b8b7-ccc63347cd6f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.163189 Nov 08 17:56:38.969908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1037/2085] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:38 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:39.165940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-29ed8243-75de-4e5b-b708-961cfa7cbf88 tempest-TestVolumeBootPattern-1590194854 tempest-TestVolumeBootPattern-1590194854-project] Getting quotas for project 549e37f0b044475983a7752fee77154b. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 17:56:39.170326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-29ed8243-75de-4e5b-b708-961cfa7cbf88 tempest-TestVolumeBootPattern-1590194854 tempest-TestVolumeBootPattern-1590194854-project] Getting quotas for user 385cd5d368df40b282de4e821a7bda0f and project 549e37f0b044475983a7752fee77154b. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 17:56:39.183518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-29ed8243-75de-4e5b-b708-961cfa7cbf88 tempest-TestVolumeBootPattern-1590194854 tempest-TestVolumeBootPattern-1590194854-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.569878 Nov 08 17:56:39.184109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1049/2086] 10.222.0.18 () {60 vars in 1157 bytes} [Mon Nov 8 17:56:38 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:39.800486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:39.801104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:39.807481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:39.808006 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:39.809048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:39.809485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:39.869435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:39.878418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:39.879964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:39.881110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-17349fb8-a635-43b9-a0d6-7d8aafe4a0d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084597 Nov 08 17:56:39.881647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1038/2087] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:39.985315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1cd7264e-f0b1-4ee9-8b45-1b5eddee3ecc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:39.985932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1cd7264e-f0b1-4ee9-8b45-1b5eddee3ecc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:39.994653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cd7264e-f0b1-4ee9-8b45-1b5eddee3ecc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:39.995344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cd7264e-f0b1-4ee9-8b45-1b5eddee3ecc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:39.996184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cd7264e-f0b1-4ee9-8b45-1b5eddee3ecc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:39.996714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cd7264e-f0b1-4ee9-8b45-1b5eddee3ecc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:40.132345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1cd7264e-f0b1-4ee9-8b45-1b5eddee3ecc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:40.141298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1cd7264e-f0b1-4ee9-8b45-1b5eddee3ecc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.160627 Nov 08 17:56:40.144510 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1050/2088] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:39 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:40.899564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:40.900163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:40.907317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:40.907762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:40.908546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:40.908974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:40.984530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:40.997167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:40.998704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:41.000140 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3b6b217a-e5f2-4272-a4a4-856f899a9d01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.104057 Nov 08 17:56:41.000701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1039/2089] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:41.157937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1cb439b0-256d-46ab-a92c-a8aa79369b06 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:41.158583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1cb439b0-256d-46ab-a92c-a8aa79369b06 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:41.164888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cb439b0-256d-46ab-a92c-a8aa79369b06 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:41.165332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cb439b0-256d-46ab-a92c-a8aa79369b06 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:41.166103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cb439b0-256d-46ab-a92c-a8aa79369b06 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:41.166553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1cb439b0-256d-46ab-a92c-a8aa79369b06 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:41.334146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1cb439b0-256d-46ab-a92c-a8aa79369b06 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:41.342023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1cb439b0-256d-46ab-a92c-a8aa79369b06 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.187969 Nov 08 17:56:41.342613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1051/2090] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:41 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:42.018745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:42.019506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:42.026122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:42.026594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:42.027392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:42.027811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:42.088529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:42.096881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:42.098380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:42.099543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-eca5a7fb-8f83-4494-a333-fa1d857c2230 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085377 Nov 08 17:56:42.100094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1040/2091] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:42.360488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-63701ab6-4c94-4b1e-9970-a8959f31fd7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:42.361036 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-63701ab6-4c94-4b1e-9970-a8959f31fd7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:42.367364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63701ab6-4c94-4b1e-9970-a8959f31fd7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:42.367811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63701ab6-4c94-4b1e-9970-a8959f31fd7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:42.368584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63701ab6-4c94-4b1e-9970-a8959f31fd7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:42.369021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63701ab6-4c94-4b1e-9970-a8959f31fd7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:42.498814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-63701ab6-4c94-4b1e-9970-a8959f31fd7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:42.507260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-63701ab6-4c94-4b1e-9970-a8959f31fd7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151224 Nov 08 17:56:42.507817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1052/2092] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:42 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:43.116936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:43.117540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:43.123588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:43.124029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:43.125458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:43.125899 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:43.184337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:43.193139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:43.194664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:43.195794 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-de521f86-a281-4c61-8157-3e17456a676d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082568 Nov 08 17:56:43.196351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1041/2093] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:43.523947 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-baab04a3-a444-4b41-8e44-09a34d0310f0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:43.524538 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-baab04a3-a444-4b41-8e44-09a34d0310f0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:43.531413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-baab04a3-a444-4b41-8e44-09a34d0310f0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:43.531858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-baab04a3-a444-4b41-8e44-09a34d0310f0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:43.532667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-baab04a3-a444-4b41-8e44-09a34d0310f0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:43.533095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-baab04a3-a444-4b41-8e44-09a34d0310f0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:43.664449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-baab04a3-a444-4b41-8e44-09a34d0310f0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:43.672263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-baab04a3-a444-4b41-8e44-09a34d0310f0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151927 Nov 08 17:56:43.672825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1053/2094] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:43 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:44.213763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:44.214371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:44.220993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:44.221444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:44.222221 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:44.222686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:44.281959 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:44.290041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:44.291567 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:44.292699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-53eb5756-43c7-4d11-83b5-39fc3bb42ddb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082688 Nov 08 17:56:44.293262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1042/2095] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:44.689737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8ce071db-2f98-4bc0-a1e5-c18108efeb17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:44.690337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8ce071db-2f98-4bc0-a1e5-c18108efeb17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:44.696431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ce071db-2f98-4bc0-a1e5-c18108efeb17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:44.696872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ce071db-2f98-4bc0-a1e5-c18108efeb17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:44.697628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ce071db-2f98-4bc0-a1e5-c18108efeb17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:44.698057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8ce071db-2f98-4bc0-a1e5-c18108efeb17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:44.828458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8ce071db-2f98-4bc0-a1e5-c18108efeb17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:44.836326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8ce071db-2f98-4bc0-a1e5-c18108efeb17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151012 Nov 08 17:56:44.836895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1054/2096] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:44 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:45.311253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:45.311858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:45.318436 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:45.318903 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:45.319674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:45.320104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:45.378585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:45.386809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:45.388344 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:45.389474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b09f9949-6e5d-46e7-8ca0-804c624d72d6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081985 Nov 08 17:56:45.390594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1043/2097] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:45.854645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2f1e661a-654a-4256-b1ac-b96e088a121a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:45.855245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2f1e661a-654a-4256-b1ac-b96e088a121a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:45.862257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f1e661a-654a-4256-b1ac-b96e088a121a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:45.862757 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f1e661a-654a-4256-b1ac-b96e088a121a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:45.863537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f1e661a-654a-4256-b1ac-b96e088a121a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:45.864026 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2f1e661a-654a-4256-b1ac-b96e088a121a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:45.996672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2f1e661a-654a-4256-b1ac-b96e088a121a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:46.005299 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2f1e661a-654a-4256-b1ac-b96e088a121a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154619 Nov 08 17:56:46.005865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1055/2098] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:45 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:46.409377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:46.409992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:46.416353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:46.416855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:46.417628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:46.418064 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:46.479063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:46.488312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:46.489837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:46.491027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f524429e-9594-4019-a15b-7f6cf4074072 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086241 Nov 08 17:56:46.491591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1044/2099] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:47.022896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0f43ca25-df17-4770-80df-08afb8b7db91 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:47.023440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0f43ca25-df17-4770-80df-08afb8b7db91 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:47.029644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f43ca25-df17-4770-80df-08afb8b7db91 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:47.030084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f43ca25-df17-4770-80df-08afb8b7db91 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:47.030877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f43ca25-df17-4770-80df-08afb8b7db91 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:47.031312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0f43ca25-df17-4770-80df-08afb8b7db91 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:47.162153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0f43ca25-df17-4770-80df-08afb8b7db91 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:47.169840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0f43ca25-df17-4770-80df-08afb8b7db91 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150703 Nov 08 17:56:47.170402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1056/2100] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:47 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:47.509444 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:47.510085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:47.516351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:47.516806 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:47.517580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:47.518017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:47.579098 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:47.587313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:47.588829 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:47.589962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cb20dfc8-e4ac-4932-966d-ebab46bc48bb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084254 Nov 08 17:56:47.590540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1045/2101] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:48.186811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e97e9fcc-6656-47a7-aebd-6fe4c88df9af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:48.187449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e97e9fcc-6656-47a7-aebd-6fe4c88df9af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:48.193741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e97e9fcc-6656-47a7-aebd-6fe4c88df9af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:48.194170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e97e9fcc-6656-47a7-aebd-6fe4c88df9af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:48.194955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e97e9fcc-6656-47a7-aebd-6fe4c88df9af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:48.195381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e97e9fcc-6656-47a7-aebd-6fe4c88df9af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:48.325764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e97e9fcc-6656-47a7-aebd-6fe4c88df9af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:48.334195 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e97e9fcc-6656-47a7-aebd-6fe4c88df9af tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150937 Nov 08 17:56:48.334799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1057/2102] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:48 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:48.608906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:48.609446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:48.615702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:48.616149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:48.616918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:48.617351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:48.674843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:48.683026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:48.684517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:48.685651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-98518e4a-64d9-4a77-9146-15da166d9673 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080568 Nov 08 17:56:48.686201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1046/2103] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:49.352123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b84cb940-ee85-4842-a510-8dae6f2fba1e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:49.352655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b84cb940-ee85-4842-a510-8dae6f2fba1e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:49.359179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b84cb940-ee85-4842-a510-8dae6f2fba1e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:49.359621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b84cb940-ee85-4842-a510-8dae6f2fba1e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:49.360390 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b84cb940-ee85-4842-a510-8dae6f2fba1e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:49.360821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b84cb940-ee85-4842-a510-8dae6f2fba1e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:49.494940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b84cb940-ee85-4842-a510-8dae6f2fba1e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:49.502784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b84cb940-ee85-4842-a510-8dae6f2fba1e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155121 Nov 08 17:56:49.503351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1058/2104] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:49 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:49.703843 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:49.704473 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:49.711283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:49.711722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:49.712487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:49.712914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:49.770841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:49.778900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:49.780385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:49.781501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0ffea720-b7ee-4a77-ab47-09d92f610fd0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081370 Nov 08 17:56:49.782051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1047/2105] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:50.519560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c62ae898-4650-49a6-a2c8-3c02361f05e5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:50.520170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c62ae898-4650-49a6-a2c8-3c02361f05e5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:50.526424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c62ae898-4650-49a6-a2c8-3c02361f05e5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:50.526912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c62ae898-4650-49a6-a2c8-3c02361f05e5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:50.527688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c62ae898-4650-49a6-a2c8-3c02361f05e5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:50.528120 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c62ae898-4650-49a6-a2c8-3c02361f05e5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:50.655051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c62ae898-4650-49a6-a2c8-3c02361f05e5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:50.663187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c62ae898-4650-49a6-a2c8-3c02361f05e5 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147443 Nov 08 17:56:50.663757 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1059/2106] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:50 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:50.799788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:50.800322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:50.807153 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:50.807616 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:50.808394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:50.808825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:50.867764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:50.876129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:50.877617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:50.878763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-99b66283-aedf-4352-88d8-9336d0789440 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082726 Nov 08 17:56:50.879322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1048/2107] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:51.679795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c871af06-34d0-456e-9e5d-2cceea6067e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:51.680398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c871af06-34d0-456e-9e5d-2cceea6067e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:51.686642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c871af06-34d0-456e-9e5d-2cceea6067e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:51.687077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c871af06-34d0-456e-9e5d-2cceea6067e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:51.687832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c871af06-34d0-456e-9e5d-2cceea6067e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:51.688255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c871af06-34d0-456e-9e5d-2cceea6067e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:51.819832 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c871af06-34d0-456e-9e5d-2cceea6067e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:51.827636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c871af06-34d0-456e-9e5d-2cceea6067e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151553 Nov 08 17:56:51.828188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1060/2108] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:51 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:51.896507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:51.897142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:51.903418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:51.903869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:51.904636 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:51.905085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:51.962875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:51.970952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:51.972448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:51.973690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5bd2bcab-be5b-4405-9260-64cba8ff2276 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080943 Nov 08 17:56:51.981130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1049/2109] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:52.847874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c0305db2-61a4-436d-938a-e7eeb0457051 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:52.849643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c0305db2-61a4-436d-938a-e7eeb0457051 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:52.856408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0305db2-61a4-436d-938a-e7eeb0457051 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:52.857057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0305db2-61a4-436d-938a-e7eeb0457051 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:52.858027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0305db2-61a4-436d-938a-e7eeb0457051 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:52.858802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0305db2-61a4-436d-938a-e7eeb0457051 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:52.890094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:52.890639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:52.900698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:52.901297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:52.901914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:52.902376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:52.926119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] HTTP exception thrown: Instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea could not be found. Nov 08 17:56:52.927017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Returning 404 to user: Instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:56:52.928122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-42f54fe8-35f9-42c7-bde0-5a85cd8658d0 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 404 len: 111 microversion: 2.1 time: 0.048010 Nov 08 17:56:52.929307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1050/2110] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 17:56:52 2021] DELETE /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 17:56:52.937173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:52.938025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: 8d9a296b-b0ac-4115-a9a2-f536ff671fea] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:52.944873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:52.945546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:52.946522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:52.947122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:52.962091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] HTTP exception thrown: Instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea could not be found. Nov 08 17:56:52.962990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Returning 404 to user: Instance 8d9a296b-b0ac-4115-a9a2-f536ff671fea could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 17:56:52.963805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d2d67d42-48c1-48aa-b6cf-0b19314f5013 tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea" status: 404 len: 111 microversion: 2.1 time: 0.030208 Nov 08 17:56:52.964816 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1051/2111] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:52 2021] GET /compute/v2.1/servers/8d9a296b-b0ac-4115-a9a2-f536ff671fea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 17:56:52.995607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:52.996230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:53.003672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:53.004753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:53.005609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:53.006269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:53.021114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c0305db2-61a4-436d-938a-e7eeb0457051 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:53.030013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c0305db2-61a4-436d-938a-e7eeb0457051 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.185962 Nov 08 17:56:53.030614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1061/2112] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:52 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:53.078427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:53.087699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:53.089304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:53.090438 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8380c206-b69e-4c04-ac1b-e281089d6a7c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.101676 Nov 08 17:56:53.091005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1052/2113] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:54.046880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-38228566-2d7f-43b3-aefc-38b854d453ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:54.047626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-38228566-2d7f-43b3-aefc-38b854d453ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:54.053889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38228566-2d7f-43b3-aefc-38b854d453ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:54.054327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38228566-2d7f-43b3-aefc-38b854d453ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:54.055204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38228566-2d7f-43b3-aefc-38b854d453ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:54.055720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38228566-2d7f-43b3-aefc-38b854d453ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:54.108526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:54.109133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:54.115927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:54.116624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:54.117467 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:54.117907 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:54.185303 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:54.193812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:54.195348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:54.196481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4a6c0f97-792d-4a4d-890f-bd9647ba1d78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.091638 Nov 08 17:56:54.197213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1053/2114] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:54.213737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-38228566-2d7f-43b3-aefc-38b854d453ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:54.222351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-38228566-2d7f-43b3-aefc-38b854d453ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.179078 Nov 08 17:56:54.223018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1062/2115] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:54 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:55.216571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:55.217212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:55.223566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:55.224009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:55.225510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:55.225955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:55.239920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8e50f59b-5eee-4a8c-8fb9-fb6b92fee592 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:55.241269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8e50f59b-5eee-4a8c-8fb9-fb6b92fee592 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:55.247499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8e50f59b-5eee-4a8c-8fb9-fb6b92fee592 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:55.247969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8e50f59b-5eee-4a8c-8fb9-fb6b92fee592 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:55.248750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8e50f59b-5eee-4a8c-8fb9-fb6b92fee592 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:55.249188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8e50f59b-5eee-4a8c-8fb9-fb6b92fee592 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:55.289103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:55.297946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:55.299488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:55.300623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5fdf9044-f2bd-4cf2-9d10-c588dd021ffc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087900 Nov 08 17:56:55.301172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1054/2116] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:55.394703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8e50f59b-5eee-4a8c-8fb9-fb6b92fee592 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:55.402784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8e50f59b-5eee-4a8c-8fb9-fb6b92fee592 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.166421 Nov 08 17:56:55.403359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1063/2117] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:55 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:56:56.320154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:56.320692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:56.326998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:56.327447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:56.328317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:56.328794 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:56.391498 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:56.399857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:56.401502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:56.402745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b49c5b02-34be-4990-b4a2-189606757d8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087042 Nov 08 17:56:56.403386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1055/2118] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:56:56.419463 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-824c2aa4-8cc3-462b-ad20-c38d737f63f3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:56.420070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-824c2aa4-8cc3-462b-ad20-c38d737f63f3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:56.426433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-824c2aa4-8cc3-462b-ad20-c38d737f63f3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:56.426909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-824c2aa4-8cc3-462b-ad20-c38d737f63f3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:56.428221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-824c2aa4-8cc3-462b-ad20-c38d737f63f3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:56.428717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-824c2aa4-8cc3-462b-ad20-c38d737f63f3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:56.560569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-824c2aa4-8cc3-462b-ad20-c38d737f63f3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:56.568845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-824c2aa4-8cc3-462b-ad20-c38d737f63f3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152556 Nov 08 17:56:56.569519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1064/2119] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:56 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:57.420752 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:57.421352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:57.427635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:57.428079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:57.428850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:57.429282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:57.492365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:57.500573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:57.502060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:57.503224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4f1fd10a-31b2-43f5-9ccf-8508f92a1af0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086270 Nov 08 17:56:57.503784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1056/2120] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:57.586495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d4c3cf70-7e0b-4867-82c4-809c0bcb8d77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:57.587105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d4c3cf70-7e0b-4867-82c4-809c0bcb8d77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:57.593282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d4c3cf70-7e0b-4867-82c4-809c0bcb8d77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:57.593727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d4c3cf70-7e0b-4867-82c4-809c0bcb8d77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:57.594506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d4c3cf70-7e0b-4867-82c4-809c0bcb8d77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:57.594933 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d4c3cf70-7e0b-4867-82c4-809c0bcb8d77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:57.730014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d4c3cf70-7e0b-4867-82c4-809c0bcb8d77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:57.737712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d4c3cf70-7e0b-4867-82c4-809c0bcb8d77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155788 Nov 08 17:56:57.738263 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1065/2121] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:57 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:58.522033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:58.522661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:58.528965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:58.529406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:58.530163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:58.530633 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:58.590800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:58.599321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:58.601103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:58.602242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b2661b2e-4e3f-46e9-ac7c-513526ae8c08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084161 Nov 08 17:56:58.602824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1057/2122] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:58.755301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-90a159f1-8078-469d-9505-df0f4d3f124f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:58.756612 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-90a159f1-8078-469d-9505-df0f4d3f124f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:58.762961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90a159f1-8078-469d-9505-df0f4d3f124f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:58.763400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90a159f1-8078-469d-9505-df0f4d3f124f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:58.764158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90a159f1-8078-469d-9505-df0f4d3f124f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:58.764584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90a159f1-8078-469d-9505-df0f4d3f124f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:58.898623 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-90a159f1-8078-469d-9505-df0f4d3f124f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:58.906542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-90a159f1-8078-469d-9505-df0f4d3f124f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154816 Nov 08 17:56:58.907115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1066/2123] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:58 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:56:59.620238 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:59.620858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:59.626973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:59.627407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:59.628163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:59.628590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:59.689478 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:59.698066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:59.699624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:56:59.700740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f72eb2ae-8a14-49b4-9cb8-67faf10e8772 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084168 Nov 08 17:56:59.701289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1058/2124] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:56:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:56:59.923973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-26b1a40d-1d61-4f8e-9a42-2817f42a5ec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:56:59.924581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-26b1a40d-1d61-4f8e-9a42-2817f42a5ec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:56:59.931088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26b1a40d-1d61-4f8e-9a42-2817f42a5ec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:59.931518 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26b1a40d-1d61-4f8e-9a42-2817f42a5ec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:56:59.932280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26b1a40d-1d61-4f8e-9a42-2817f42a5ec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:56:59.932704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26b1a40d-1d61-4f8e-9a42-2817f42a5ec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:00.066560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26b1a40d-1d61-4f8e-9a42-2817f42a5ec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:00.074830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-26b1a40d-1d61-4f8e-9a42-2817f42a5ec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154625 Nov 08 17:57:00.075408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1067/2125] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:56:59 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:00.718632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:00.719171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:00.725346 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:00.725810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:00.726682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:00.727224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:00.787470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:00.795706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:00.797253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:00.798370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-de3e19bb-0b2f-4d82-ac6a-fd33ba02f74f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083570 Nov 08 17:57:00.798949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1059/2126] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:01.091693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a38aed62-dbd0-4be4-8d1d-a10a9098740d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:01.092301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a38aed62-dbd0-4be4-8d1d-a10a9098740d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:01.098726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a38aed62-dbd0-4be4-8d1d-a10a9098740d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:01.099168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a38aed62-dbd0-4be4-8d1d-a10a9098740d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:01.099945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a38aed62-dbd0-4be4-8d1d-a10a9098740d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:01.100479 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a38aed62-dbd0-4be4-8d1d-a10a9098740d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:01.235117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a38aed62-dbd0-4be4-8d1d-a10a9098740d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:01.243706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a38aed62-dbd0-4be4-8d1d-a10a9098740d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155679 Nov 08 17:57:01.244206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1068/2127] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:01 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:01.817705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:01.818364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:01.824642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:01.825087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:01.825857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:01.826287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:01.887541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:01.895814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:01.897976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:01.899130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-90ab15b2-0efd-483d-9841-f8ae66c0a167 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085167 Nov 08 17:57:01.899715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1060/2128] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:02.261525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f88ec06b-6630-4a2a-81dd-a556ffcf8c8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:02.262362 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f88ec06b-6630-4a2a-81dd-a556ffcf8c8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:02.269014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f88ec06b-6630-4a2a-81dd-a556ffcf8c8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:02.269457 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f88ec06b-6630-4a2a-81dd-a556ffcf8c8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:02.270236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f88ec06b-6630-4a2a-81dd-a556ffcf8c8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:02.270695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f88ec06b-6630-4a2a-81dd-a556ffcf8c8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:02.403337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f88ec06b-6630-4a2a-81dd-a556ffcf8c8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:02.411864 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f88ec06b-6630-4a2a-81dd-a556ffcf8c8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155002 Nov 08 17:57:02.412535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1069/2129] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:02 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:02.917164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:02.917774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:02.924326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:02.924770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:02.925544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:02.925983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:02.996764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:03.004811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:03.007013 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:03.008185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1806f2c2-6fa1-4f78-a429-e82805cdf2ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.094760 Nov 08 17:57:03.008743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1061/2130] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:03.429416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fade2aa2-e9d8-4f2d-9fdf-0db074d15dd3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:03.430117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fade2aa2-e9d8-4f2d-9fdf-0db074d15dd3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:03.436234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fade2aa2-e9d8-4f2d-9fdf-0db074d15dd3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:03.436678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fade2aa2-e9d8-4f2d-9fdf-0db074d15dd3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:03.437431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fade2aa2-e9d8-4f2d-9fdf-0db074d15dd3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:03.437858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fade2aa2-e9d8-4f2d-9fdf-0db074d15dd3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:03.568413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fade2aa2-e9d8-4f2d-9fdf-0db074d15dd3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:03.576264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fade2aa2-e9d8-4f2d-9fdf-0db074d15dd3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151131 Nov 08 17:57:03.576835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1070/2131] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:03 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:04.026018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:04.026651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:04.032893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:04.033337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:04.034104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:04.034564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:04.095378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:04.105181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:04.106762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:04.107935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-93dae0ae-37e9-48b4-8072-22027b8dec09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085718 Nov 08 17:57:04.108496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1062/2132] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:04.592863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4fad8b22-b7df-4c19-ad36-8497769bc489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:04.593462 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4fad8b22-b7df-4c19-ad36-8497769bc489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:04.599731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4fad8b22-b7df-4c19-ad36-8497769bc489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:04.600169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4fad8b22-b7df-4c19-ad36-8497769bc489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:04.602165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4fad8b22-b7df-4c19-ad36-8497769bc489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:04.602637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4fad8b22-b7df-4c19-ad36-8497769bc489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:04.747767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4fad8b22-b7df-4c19-ad36-8497769bc489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:04.753152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4fad8b22-b7df-4c19-ad36-8497769bc489 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.163956 Nov 08 17:57:04.753725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1071/2133] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:04 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:05.126395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:05.126983 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:05.133826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:05.134276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:05.135336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:05.135874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:05.194916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:05.203524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:05.205551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:05.206743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9465bfbc-6418-426e-9c7b-bab8e562a140 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084079 Nov 08 17:57:05.207305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1063/2134] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:05.769071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9417750a-5145-42c9-bb4d-4d294684b1c6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:05.769678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9417750a-5145-42c9-bb4d-4d294684b1c6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:05.775875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9417750a-5145-42c9-bb4d-4d294684b1c6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:05.778406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9417750a-5145-42c9-bb4d-4d294684b1c6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:05.778406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9417750a-5145-42c9-bb4d-4d294684b1c6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:05.778406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9417750a-5145-42c9-bb4d-4d294684b1c6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:05.907063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9417750a-5145-42c9-bb4d-4d294684b1c6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:05.915521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9417750a-5145-42c9-bb4d-4d294684b1c6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150027 Nov 08 17:57:05.916086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1072/2135] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:05 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:06.224879 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:06.225630 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:06.242781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:06.242781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:06.242781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:06.242781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:06.298279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:06.306565 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:06.308097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:06.309223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-435cf5fa-ae53-47bb-8024-075a07b7d795 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.088057 Nov 08 17:57:06.309780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1064/2136] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:06.932844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dc2c8b80-402f-4cf0-9340-5449ed4deb79 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:06.933442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dc2c8b80-402f-4cf0-9340-5449ed4deb79 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:06.939652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc2c8b80-402f-4cf0-9340-5449ed4deb79 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:06.940093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc2c8b80-402f-4cf0-9340-5449ed4deb79 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:06.940852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc2c8b80-402f-4cf0-9340-5449ed4deb79 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:06.941274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc2c8b80-402f-4cf0-9340-5449ed4deb79 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:07.072099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dc2c8b80-402f-4cf0-9340-5449ed4deb79 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:07.079715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dc2c8b80-402f-4cf0-9340-5449ed4deb79 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151186 Nov 08 17:57:07.080281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1073/2137] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:06 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:07.327516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:07.328163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:07.334284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:07.334768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:07.336206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:07.336639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:07.395357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:07.404021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:07.405507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:07.406655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-378d102b-3c52-4b07-af16-425c9ba71a65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082976 Nov 08 17:57:07.407208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1065/2138] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:08.097190 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1e8ca22f-f3a0-4e1d-b583-7cb6a72b9183 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:08.097805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1e8ca22f-f3a0-4e1d-b583-7cb6a72b9183 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:08.105179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e8ca22f-f3a0-4e1d-b583-7cb6a72b9183 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:08.105628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e8ca22f-f3a0-4e1d-b583-7cb6a72b9183 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:08.106408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e8ca22f-f3a0-4e1d-b583-7cb6a72b9183 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:08.106873 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e8ca22f-f3a0-4e1d-b583-7cb6a72b9183 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:08.234345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1e8ca22f-f3a0-4e1d-b583-7cb6a72b9183 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:08.242041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1e8ca22f-f3a0-4e1d-b583-7cb6a72b9183 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148548 Nov 08 17:57:08.242560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1074/2139] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:08 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:08.424945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:08.425535 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:08.431898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:08.432341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:08.433100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:08.433528 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:08.495212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:08.503308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:08.504803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:08.505924 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c4eb3b63-d27f-4945-8405-4aa16ab5944c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084776 Nov 08 17:57:08.506496 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1066/2140] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:09.258966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cc95d137-ef60-423b-bc9c-14c27d448bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:09.259540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cc95d137-ef60-423b-bc9c-14c27d448bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:09.266436 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc95d137-ef60-423b-bc9c-14c27d448bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:09.266900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc95d137-ef60-423b-bc9c-14c27d448bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:09.267662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc95d137-ef60-423b-bc9c-14c27d448bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:09.268087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cc95d137-ef60-423b-bc9c-14c27d448bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:09.396009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cc95d137-ef60-423b-bc9c-14c27d448bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:09.404250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cc95d137-ef60-423b-bc9c-14c27d448bd0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149003 Nov 08 17:57:09.404814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1075/2141] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:09 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:09.508625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:57:09.508845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 17:57:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:57:09.523445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:09.523959 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:09.530160 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:09.530628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:09.531393 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:09.531820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:09.590010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:09.598034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:09.599547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:09.601156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dcf12832-19c1-4207-95d5-2d86cf0ee375 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080981 Nov 08 17:57:09.601693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1067/2142] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:10.421398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e73c57c4-6b9d-4cda-875a-2983d3fc3820 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:10.422009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e73c57c4-6b9d-4cda-875a-2983d3fc3820 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:10.428153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e73c57c4-6b9d-4cda-875a-2983d3fc3820 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:10.428591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e73c57c4-6b9d-4cda-875a-2983d3fc3820 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:10.429581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e73c57c4-6b9d-4cda-875a-2983d3fc3820 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:10.430016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e73c57c4-6b9d-4cda-875a-2983d3fc3820 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:10.563192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e73c57c4-6b9d-4cda-875a-2983d3fc3820 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:10.571619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e73c57c4-6b9d-4cda-875a-2983d3fc3820 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153824 Nov 08 17:57:10.572208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1076/2143] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:10 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:10.619491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:10.620099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:10.626306 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:10.626779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:10.627547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:10.627980 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:10.685886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:10.694062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:10.696323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:10.697447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-69b28b8a-8388-4347-ab06-00a45a6ed054 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082167 Nov 08 17:57:10.698029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1068/2144] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:11.589134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e2152a4b-df49-472e-8171-c472cd9681cd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:11.589739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e2152a4b-df49-472e-8171-c472cd9681cd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:11.596083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2152a4b-df49-472e-8171-c472cd9681cd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:11.596529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2152a4b-df49-472e-8171-c472cd9681cd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:11.597298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2152a4b-df49-472e-8171-c472cd9681cd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:11.597737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2152a4b-df49-472e-8171-c472cd9681cd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:11.715855 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:11.716452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:11.723109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:11.723458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:11.724232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:11.724666 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:11.725134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e2152a4b-df49-472e-8171-c472cd9681cd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:11.733508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e2152a4b-df49-472e-8171-c472cd9681cd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148751 Nov 08 17:57:11.734073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1077/2145] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:11 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:11.786526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:11.794898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:11.796455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:11.797571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b494291b-c427-4b4a-b674-85d8874e8e6f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085427 Nov 08 17:57:11.798146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1069/2146] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:12.750448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1ec82f68-4138-463a-9b07-04dc2bcd141e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:12.751071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1ec82f68-4138-463a-9b07-04dc2bcd141e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:12.757444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ec82f68-4138-463a-9b07-04dc2bcd141e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:12.758069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ec82f68-4138-463a-9b07-04dc2bcd141e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:12.758908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ec82f68-4138-463a-9b07-04dc2bcd141e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:12.759339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ec82f68-4138-463a-9b07-04dc2bcd141e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:12.815062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:12.815758 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:12.822719 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:12.823506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:12.824667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:12.825135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:12.901933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:12.911055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:12.912562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:12.913707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0ce48e8d-b3f7-4382-b4bf-5b854f059e8d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.102418 Nov 08 17:57:12.914873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1070/2147] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:12.925063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1ec82f68-4138-463a-9b07-04dc2bcd141e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:12.933244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1ec82f68-4138-463a-9b07-04dc2bcd141e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.186551 Nov 08 17:57:12.933808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1078/2148] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:12 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:13.934014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:13.934634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:13.941301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:13.941826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:13.942639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:13.943082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:13.949999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-20f7d525-bdf8-4005-be0d-5a8ddfa19f07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:13.950643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-20f7d525-bdf8-4005-be0d-5a8ddfa19f07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:13.956834 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-20f7d525-bdf8-4005-be0d-5a8ddfa19f07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:13.957272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-20f7d525-bdf8-4005-be0d-5a8ddfa19f07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:13.958035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-20f7d525-bdf8-4005-be0d-5a8ddfa19f07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:13.958474 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-20f7d525-bdf8-4005-be0d-5a8ddfa19f07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:14.016520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:14.024775 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:14.026798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:14.027938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5d22e02c-dea5-4328-8ed7-c96a8eb6ed4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.098116 Nov 08 17:57:14.028492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1071/2149] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:14.100144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-20f7d525-bdf8-4005-be0d-5a8ddfa19f07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:14.108094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-20f7d525-bdf8-4005-be0d-5a8ddfa19f07 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.162116 Nov 08 17:57:14.108652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1079/2150] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:13 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:57:15.046658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:15.047302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:15.053495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:15.053940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:15.054747 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:15.055179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:15.117858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:15.124636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2b540f32-e0e5-41a9-9bfb-ee44bbffa20d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:15.125255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2b540f32-e0e5-41a9-9bfb-ee44bbffa20d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:15.126348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:15.127946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:15.129069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-199c47ff-ab8f-4ce6-b84c-0108495f4ffe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086272 Nov 08 17:57:15.129632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1072/2151] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:15.131624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2b540f32-e0e5-41a9-9bfb-ee44bbffa20d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:15.132018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2b540f32-e0e5-41a9-9bfb-ee44bbffa20d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:15.132794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2b540f32-e0e5-41a9-9bfb-ee44bbffa20d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:15.133232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2b540f32-e0e5-41a9-9bfb-ee44bbffa20d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:15.261077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2b540f32-e0e5-41a9-9bfb-ee44bbffa20d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:15.268937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2b540f32-e0e5-41a9-9bfb-ee44bbffa20d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147902 Nov 08 17:57:15.269496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1080/2152] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:15 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:57:16.146560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:16.147157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:16.153798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:16.154248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:16.155087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:16.155552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:16.214081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:16.222296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:16.223834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:16.224969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-50cb50f9-39a0-401a-8e27-ccd343cbca66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082163 Nov 08 17:57:16.225519 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1073/2153] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:16.285678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dbdbe2ea-ed15-4d85-9855-93792dc8bfdd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:16.286189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dbdbe2ea-ed15-4d85-9855-93792dc8bfdd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:16.293285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbdbe2ea-ed15-4d85-9855-93792dc8bfdd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:16.293720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbdbe2ea-ed15-4d85-9855-93792dc8bfdd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:16.294497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbdbe2ea-ed15-4d85-9855-93792dc8bfdd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:16.294924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dbdbe2ea-ed15-4d85-9855-93792dc8bfdd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:16.424389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dbdbe2ea-ed15-4d85-9855-93792dc8bfdd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:16.432281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dbdbe2ea-ed15-4d85-9855-93792dc8bfdd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150306 Nov 08 17:57:16.432838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1081/2154] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:16 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:17.242808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:17.243369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:17.250052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:17.250511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:17.251269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:17.251693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:17.309918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:17.317932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:17.319434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:17.320546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2fc2ccf8-db56-4c6f-b504-830096018209 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081496 Nov 08 17:57:17.321091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1074/2155] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:17.449379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-45034299-e446-4379-bc2f-2a3fa5b62d8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:17.449982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-45034299-e446-4379-bc2f-2a3fa5b62d8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:17.456294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-45034299-e446-4379-bc2f-2a3fa5b62d8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:17.456730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-45034299-e446-4379-bc2f-2a3fa5b62d8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:17.457488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-45034299-e446-4379-bc2f-2a3fa5b62d8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:17.457912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-45034299-e446-4379-bc2f-2a3fa5b62d8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:17.583811 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-45034299-e446-4379-bc2f-2a3fa5b62d8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:17.591761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-45034299-e446-4379-bc2f-2a3fa5b62d8b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146697 Nov 08 17:57:17.592311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1082/2156] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:17 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:18.339838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:18.340384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:18.346780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:18.347218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:18.347973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:18.348398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:18.406059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:18.414075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:18.415610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:18.416744 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4df3975f-b906-460c-a5c8-216d8855a7a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081480 Nov 08 17:57:18.417344 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1075/2157] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:18.608490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fdeea938-295a-4150-aab3-2f9e2c979678 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:18.609043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fdeea938-295a-4150-aab3-2f9e2c979678 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:18.615326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdeea938-295a-4150-aab3-2f9e2c979678 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:18.615764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdeea938-295a-4150-aab3-2f9e2c979678 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:18.616528 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdeea938-295a-4150-aab3-2f9e2c979678 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:18.616954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdeea938-295a-4150-aab3-2f9e2c979678 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:18.748402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fdeea938-295a-4150-aab3-2f9e2c979678 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:18.756252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fdeea938-295a-4150-aab3-2f9e2c979678 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152000 Nov 08 17:57:18.756806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1083/2158] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:18 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:19.435107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:19.435711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:19.442080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:19.442707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:19.443483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:19.443921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:19.503879 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:19.512695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:19.514190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:19.515348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-23974098-8e75-44fb-a25b-8d082b568f09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084595 Nov 08 17:57:19.515905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1076/2159] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:19.774535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-698b8f3d-9819-4a1c-999d-9d5d97d816e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:19.775111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-698b8f3d-9819-4a1c-999d-9d5d97d816e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:19.781394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-698b8f3d-9819-4a1c-999d-9d5d97d816e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:19.781827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-698b8f3d-9819-4a1c-999d-9d5d97d816e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:19.782626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-698b8f3d-9819-4a1c-999d-9d5d97d816e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:19.783058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-698b8f3d-9819-4a1c-999d-9d5d97d816e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:19.918165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-698b8f3d-9819-4a1c-999d-9d5d97d816e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:19.925970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-698b8f3d-9819-4a1c-999d-9d5d97d816e3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155167 Nov 08 17:57:19.926556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1084/2160] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:19 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:20.533290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:20.533887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:20.540144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:20.540583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:20.541340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:20.541770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:20.604421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:20.612659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:20.614159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:20.615286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6007e00d-bcaa-4118-a6d7-395b20aebcf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085708 Nov 08 17:57:20.615835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1077/2161] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:20.944112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6bcc3806-f287-4a64-941e-c7029eeac1cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:20.944729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6bcc3806-f287-4a64-941e-c7029eeac1cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:20.951604 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bcc3806-f287-4a64-941e-c7029eeac1cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:20.952051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bcc3806-f287-4a64-941e-c7029eeac1cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:20.952820 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bcc3806-f287-4a64-941e-c7029eeac1cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:20.953255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bcc3806-f287-4a64-941e-c7029eeac1cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:21.080285 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6bcc3806-f287-4a64-941e-c7029eeac1cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:21.088041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6bcc3806-f287-4a64-941e-c7029eeac1cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147547 Nov 08 17:57:21.088614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1085/2162] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:20 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:21.633154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:21.633784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:21.640111 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:21.640556 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:21.641320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:21.641753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:21.700215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:21.708291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:21.709784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:21.710933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6859e491-2f4f-4777-a6ff-5d7d334ec29c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081564 Nov 08 17:57:21.711487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1078/2163] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:22.105051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d5b5bacc-a067-4714-94e0-e6fa0f1d7aa7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:22.105640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d5b5bacc-a067-4714-94e0-e6fa0f1d7aa7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:22.111888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5b5bacc-a067-4714-94e0-e6fa0f1d7aa7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:22.112325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5b5bacc-a067-4714-94e0-e6fa0f1d7aa7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:22.113075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5b5bacc-a067-4714-94e0-e6fa0f1d7aa7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:22.113499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d5b5bacc-a067-4714-94e0-e6fa0f1d7aa7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:22.241437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d5b5bacc-a067-4714-94e0-e6fa0f1d7aa7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:22.249323 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d5b5bacc-a067-4714-94e0-e6fa0f1d7aa7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148175 Nov 08 17:57:22.249880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1086/2164] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:22 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:22.732146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:22.732779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:22.739174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:22.739615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:22.740391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:22.740824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:22.800957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:22.811032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:22.812517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:22.814092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-437ee7f8-ee06-4fbb-ab08-cc5eb5385b96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086716 Nov 08 17:57:22.814674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1079/2165] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:23.266042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5d881f27-8c18-4a2f-9c08-8572a92bad7b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:23.266634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5d881f27-8c18-4a2f-9c08-8572a92bad7b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:23.272803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5d881f27-8c18-4a2f-9c08-8572a92bad7b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:23.273244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5d881f27-8c18-4a2f-9c08-8572a92bad7b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:23.274008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5d881f27-8c18-4a2f-9c08-8572a92bad7b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:23.274442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5d881f27-8c18-4a2f-9c08-8572a92bad7b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:23.403131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5d881f27-8c18-4a2f-9c08-8572a92bad7b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:23.410814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5d881f27-8c18-4a2f-9c08-8572a92bad7b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148443 Nov 08 17:57:23.411379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1087/2166] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:23 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:23.832878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:23.833483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:23.840167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:23.840609 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:23.841386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:23.841815 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:23.908976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:23.917994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:23.919530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:23.920646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6c7b7dc7-2964-438b-b8d2-956f84f2b175 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.091533 Nov 08 17:57:23.921199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1080/2167] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:24.428643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-71bc6ddc-c70e-4e48-ac37-5c9e519a513d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:24.429255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-71bc6ddc-c70e-4e48-ac37-5c9e519a513d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:24.435737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71bc6ddc-c70e-4e48-ac37-5c9e519a513d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:24.436179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71bc6ddc-c70e-4e48-ac37-5c9e519a513d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:24.436974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71bc6ddc-c70e-4e48-ac37-5c9e519a513d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:24.437405 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71bc6ddc-c70e-4e48-ac37-5c9e519a513d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:24.568549 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-71bc6ddc-c70e-4e48-ac37-5c9e519a513d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:24.576664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-71bc6ddc-c70e-4e48-ac37-5c9e519a513d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151697 Nov 08 17:57:24.577223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1088/2168] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:24 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:24.938588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:24.939191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:24.945395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:24.945835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:24.946623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:24.947052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:25.008379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:25.016762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:25.018262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:25.019419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-250e89b2-2fbc-410e-bd66-e3e6af189211 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084561 Nov 08 17:57:25.019970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1081/2169] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:25.593209 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e0deb0c1-1a84-4ef1-9cd5-2fbfebb37622 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:25.593813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e0deb0c1-1a84-4ef1-9cd5-2fbfebb37622 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:25.599962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e0deb0c1-1a84-4ef1-9cd5-2fbfebb37622 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:25.600399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e0deb0c1-1a84-4ef1-9cd5-2fbfebb37622 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:25.601148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e0deb0c1-1a84-4ef1-9cd5-2fbfebb37622 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:25.601573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e0deb0c1-1a84-4ef1-9cd5-2fbfebb37622 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:25.730414 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e0deb0c1-1a84-4ef1-9cd5-2fbfebb37622 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:25.738116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e0deb0c1-1a84-4ef1-9cd5-2fbfebb37622 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148589 Nov 08 17:57:25.738706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1089/2170] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:25 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:26.036902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:26.037533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:26.044800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:26.045246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:26.046020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:26.046465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:26.108540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:26.116583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:26.118087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:26.119244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f469ac45-0f4d-42d8-95e4-8457333ae82d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086016 Nov 08 17:57:26.124642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1082/2171] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:26.755465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-701ea14b-f413-4baf-937f-3695f7c1e9ed tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:26.756063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-701ea14b-f413-4baf-937f-3695f7c1e9ed tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:26.762768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-701ea14b-f413-4baf-937f-3695f7c1e9ed tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:26.763205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-701ea14b-f413-4baf-937f-3695f7c1e9ed tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:26.763957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-701ea14b-f413-4baf-937f-3695f7c1e9ed tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:26.764383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-701ea14b-f413-4baf-937f-3695f7c1e9ed tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:26.890052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-701ea14b-f413-4baf-937f-3695f7c1e9ed tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:26.897674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-701ea14b-f413-4baf-937f-3695f7c1e9ed tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145825 Nov 08 17:57:26.898228 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1090/2172] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:26 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:27.138539 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:27.139126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:27.145252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:27.150060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:27.150060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:27.150060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:27.205640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:27.213811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:27.215353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:27.216469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7bb43f70-bb5d-4088-8a71-ddecf9b27a97 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082382 Nov 08 17:57:27.217018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1083/2173] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:27.914532 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-42652bb3-de8d-4192-a908-982636e61f98 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:27.915131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-42652bb3-de8d-4192-a908-982636e61f98 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:27.922078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42652bb3-de8d-4192-a908-982636e61f98 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:27.922540 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42652bb3-de8d-4192-a908-982636e61f98 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:27.923301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42652bb3-de8d-4192-a908-982636e61f98 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:27.923729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42652bb3-de8d-4192-a908-982636e61f98 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:28.052689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-42652bb3-de8d-4192-a908-982636e61f98 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:28.060490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-42652bb3-de8d-4192-a908-982636e61f98 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149624 Nov 08 17:57:28.061054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1091/2174] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:27 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:28.233479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:28.234012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:28.240220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:28.240654 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:28.241415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:28.241837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:28.299552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:28.307607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:28.309206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:28.310317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e2365f68-02b1-4246-82fa-2203bc7e251b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080599 Nov 08 17:57:28.310955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1084/2175] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:29.076948 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e682ef42-0dce-4786-8789-2fcae013ae03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:29.077548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e682ef42-0dce-4786-8789-2fcae013ae03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:29.083747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e682ef42-0dce-4786-8789-2fcae013ae03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:29.084181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e682ef42-0dce-4786-8789-2fcae013ae03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:29.084943 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e682ef42-0dce-4786-8789-2fcae013ae03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:29.085370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e682ef42-0dce-4786-8789-2fcae013ae03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:29.210514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e682ef42-0dce-4786-8789-2fcae013ae03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:29.218903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e682ef42-0dce-4786-8789-2fcae013ae03 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145659 Nov 08 17:57:29.219453 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1092/2176] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:29 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:29.328181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:29.328779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:29.335019 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:29.335457 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:29.336216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:29.336642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:29.394261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:29.403081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:29.404566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:29.405684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6abc9f1b-b76f-42f0-81aa-a3cd653d05b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081211 Nov 08 17:57:29.406235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1085/2177] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:30.235530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-832fb2f9-9da5-4c29-ad58-2bdb3d0896bd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:30.236136 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-832fb2f9-9da5-4c29-ad58-2bdb3d0896bd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:30.242492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-832fb2f9-9da5-4c29-ad58-2bdb3d0896bd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:30.242887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-832fb2f9-9da5-4c29-ad58-2bdb3d0896bd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:30.243653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-832fb2f9-9da5-4c29-ad58-2bdb3d0896bd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:30.244087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-832fb2f9-9da5-4c29-ad58-2bdb3d0896bd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:30.376889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-832fb2f9-9da5-4c29-ad58-2bdb3d0896bd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:30.384625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-832fb2f9-9da5-4c29-ad58-2bdb3d0896bd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152815 Nov 08 17:57:30.385196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1093/2178] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:30 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:30.423864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:30.424458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:30.430714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:30.431152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:30.431915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:30.432342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:30.490559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:30.499264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:30.500725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:30.501842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-44cc4a97-73af-4ddd-a730-0870655488d0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081651 Nov 08 17:57:30.502394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1086/2179] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:31.401080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-be9508d5-b39d-4080-a8b1-7475ee247e95 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:31.401713 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-be9508d5-b39d-4080-a8b1-7475ee247e95 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:31.407894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be9508d5-b39d-4080-a8b1-7475ee247e95 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:31.408330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be9508d5-b39d-4080-a8b1-7475ee247e95 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:31.409083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be9508d5-b39d-4080-a8b1-7475ee247e95 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:31.409507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be9508d5-b39d-4080-a8b1-7475ee247e95 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:31.519341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:31.520001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:31.526278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:31.526785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:31.527786 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:31.528347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:31.538046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-be9508d5-b39d-4080-a8b1-7475ee247e95 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:31.546121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-be9508d5-b39d-4080-a8b1-7475ee247e95 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148706 Nov 08 17:57:31.546713 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1094/2180] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:31 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:31.591826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:31.599982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:31.601481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:31.602906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-60dd7fb0-7a4f-4b58-9eda-6001afa75a7e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087069 Nov 08 17:57:31.603642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1087/2181] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:32.562803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cf98bd8c-fa9f-4217-9dee-3ab65e90d47b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:32.563418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cf98bd8c-fa9f-4217-9dee-3ab65e90d47b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:32.569651 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cf98bd8c-fa9f-4217-9dee-3ab65e90d47b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:32.570098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cf98bd8c-fa9f-4217-9dee-3ab65e90d47b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:32.570913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cf98bd8c-fa9f-4217-9dee-3ab65e90d47b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:32.571351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cf98bd8c-fa9f-4217-9dee-3ab65e90d47b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:32.620355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:32.621027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:32.627385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:32.627834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:32.628644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:32.629108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:32.695106 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:32.704350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:32.705838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:32.706994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3b4e0bc7-2b25-4e88-bd5e-c839cb66f03b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.090340 Nov 08 17:57:32.707561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1088/2182] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:32.720904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cf98bd8c-fa9f-4217-9dee-3ab65e90d47b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:32.728930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cf98bd8c-fa9f-4217-9dee-3ab65e90d47b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.169775 Nov 08 17:57:32.729492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1095/2183] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:32 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:33.725427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:33.726017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:33.733119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:33.733564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:33.734330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:33.734784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:33.744663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-589ddc08-5af8-443c-be51-fb529af3352f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:33.745269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-589ddc08-5af8-443c-be51-fb529af3352f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:33.751751 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-589ddc08-5af8-443c-be51-fb529af3352f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:33.752196 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-589ddc08-5af8-443c-be51-fb529af3352f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:33.752966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-589ddc08-5af8-443c-be51-fb529af3352f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:33.753394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-589ddc08-5af8-443c-be51-fb529af3352f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:33.794664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:33.802874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:33.804377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:33.805521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-79112f61-b7aa-4da9-929f-518a7eb3e7b3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083816 Nov 08 17:57:33.806076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1089/2184] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:33.900142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-589ddc08-5af8-443c-be51-fb529af3352f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:33.908508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-589ddc08-5af8-443c-be51-fb529af3352f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.167444 Nov 08 17:57:33.909090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1096/2185] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:33 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:57:34.823170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:34.823804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:34.830040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:34.830506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:34.831280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:34.831711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:34.889968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:34.898138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:34.899733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:34.900852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c8b3fe89-8d0b-4a03-8701-14be9e01f37c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081502 Nov 08 17:57:34.901399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1090/2186] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:34.924673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d26cefaa-d71c-4f69-a13a-6dd3ed81e374 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:34.925280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d26cefaa-d71c-4f69-a13a-6dd3ed81e374 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:34.931512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d26cefaa-d71c-4f69-a13a-6dd3ed81e374 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:34.931951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d26cefaa-d71c-4f69-a13a-6dd3ed81e374 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:34.932715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d26cefaa-d71c-4f69-a13a-6dd3ed81e374 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:34.933148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d26cefaa-d71c-4f69-a13a-6dd3ed81e374 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:35.060817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d26cefaa-d71c-4f69-a13a-6dd3ed81e374 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:35.068537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d26cefaa-d71c-4f69-a13a-6dd3ed81e374 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147460 Nov 08 17:57:35.069089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1097/2187] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:34 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:35.919165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:35.919764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:35.925961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:35.929795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:35.929795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:35.929795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:35.991054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:36.000104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:36.001628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:36.002780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5719f945-1eea-4a46-8e4f-cc5f81c9b116 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087965 Nov 08 17:57:36.003332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1091/2188] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:36.084759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-81156310-8f71-4076-ae3b-12157eece575 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:36.085368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-81156310-8f71-4076-ae3b-12157eece575 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:36.092188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-81156310-8f71-4076-ae3b-12157eece575 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:36.092628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-81156310-8f71-4076-ae3b-12157eece575 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:36.093391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-81156310-8f71-4076-ae3b-12157eece575 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:36.093822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-81156310-8f71-4076-ae3b-12157eece575 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:36.221176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-81156310-8f71-4076-ae3b-12157eece575 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:36.229567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-81156310-8f71-4076-ae3b-12157eece575 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148371 Nov 08 17:57:36.230137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1098/2189] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:36 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:37.020608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:37.021209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:37.027453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:37.027905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:37.028717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:37.029145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:37.087962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:37.096654 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:37.098147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:37.099312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2e418314-024b-4f36-aa56-acfb53e6aaf1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082407 Nov 08 17:57:37.099865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1092/2190] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:37.246288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1e864b3b-14fc-4ac5-ae50-d16ee0f1f115 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:37.247471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1e864b3b-14fc-4ac5-ae50-d16ee0f1f115 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:37.253598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e864b3b-14fc-4ac5-ae50-d16ee0f1f115 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:37.255053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e864b3b-14fc-4ac5-ae50-d16ee0f1f115 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:37.255053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e864b3b-14fc-4ac5-ae50-d16ee0f1f115 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:37.255266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1e864b3b-14fc-4ac5-ae50-d16ee0f1f115 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:37.383049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1e864b3b-14fc-4ac5-ae50-d16ee0f1f115 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:37.390793 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1e864b3b-14fc-4ac5-ae50-d16ee0f1f115 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148170 Nov 08 17:57:37.391354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1099/2191] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:37 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:38.117601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:38.118194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:38.125002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:38.125443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:38.126203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:38.126658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:38.183798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:38.192322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:38.193844 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:38.194984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-945636b5-0c1c-4068-8d0a-aa5fbaefb04d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081066 Nov 08 17:57:38.195536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1093/2192] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:38.407696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2935945b-5fa6-48dc-a50c-7784e15e9651 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:38.408304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2935945b-5fa6-48dc-a50c-7784e15e9651 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:38.414523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2935945b-5fa6-48dc-a50c-7784e15e9651 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:38.414966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2935945b-5fa6-48dc-a50c-7784e15e9651 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:38.415732 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2935945b-5fa6-48dc-a50c-7784e15e9651 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:38.416158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2935945b-5fa6-48dc-a50c-7784e15e9651 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:38.540973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2935945b-5fa6-48dc-a50c-7784e15e9651 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:38.549180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2935945b-5fa6-48dc-a50c-7784e15e9651 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145256 Nov 08 17:57:38.549744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1100/2193] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:38 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:39.213029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:39.213563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:39.220449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:39.220883 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:39.221643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:39.222067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:39.279601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:39.287659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:39.289137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:39.290256 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f39a2e34-136d-4e46-825d-46224e996e1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081033 Nov 08 17:57:39.290833 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1094/2194] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:39.565911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dc575bab-a60c-4bc3-9e6e-ba80b868040b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:39.566484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dc575bab-a60c-4bc3-9e6e-ba80b868040b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:39.572685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc575bab-a60c-4bc3-9e6e-ba80b868040b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:39.573121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc575bab-a60c-4bc3-9e6e-ba80b868040b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:39.573935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc575bab-a60c-4bc3-9e6e-ba80b868040b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:39.574547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dc575bab-a60c-4bc3-9e6e-ba80b868040b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:39.704131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dc575bab-a60c-4bc3-9e6e-ba80b868040b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:39.711685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dc575bab-a60c-4bc3-9e6e-ba80b868040b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149619 Nov 08 17:57:39.712234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1101/2195] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:39 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:40.308439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:40.308977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:40.315876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:40.316315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:40.317066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:40.317489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:40.375456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:40.383511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:40.384987 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:40.386092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6e53471b-a598-43b7-827c-d75277d55659 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081417 Nov 08 17:57:40.386667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1095/2196] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:40.728584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8706b946-e055-45ef-a0fe-9275ecf97949 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:40.729192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8706b946-e055-45ef-a0fe-9275ecf97949 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:40.735864 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8706b946-e055-45ef-a0fe-9275ecf97949 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:40.736307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8706b946-e055-45ef-a0fe-9275ecf97949 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:40.737074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8706b946-e055-45ef-a0fe-9275ecf97949 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:40.737504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8706b946-e055-45ef-a0fe-9275ecf97949 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:40.864399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8706b946-e055-45ef-a0fe-9275ecf97949 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:40.872123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8706b946-e055-45ef-a0fe-9275ecf97949 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147321 Nov 08 17:57:40.872680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1102/2197] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:40 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:41.404726 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:41.405408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:41.411922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:41.412368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:41.413133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:41.413564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:41.475678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:41.484779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:41.486270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:41.487428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7f2bf941-87cb-4652-adb1-e764cc1871d7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086546 Nov 08 17:57:41.487988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1096/2198] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:41.888877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8edacbd9-a669-4746-a0a9-137200cc33ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:41.889514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8edacbd9-a669-4746-a0a9-137200cc33ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:41.895743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8edacbd9-a669-4746-a0a9-137200cc33ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:41.896186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8edacbd9-a669-4746-a0a9-137200cc33ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:41.896945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8edacbd9-a669-4746-a0a9-137200cc33ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:41.897375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8edacbd9-a669-4746-a0a9-137200cc33ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:42.023265 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8edacbd9-a669-4746-a0a9-137200cc33ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:42.031911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8edacbd9-a669-4746-a0a9-137200cc33ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146831 Nov 08 17:57:42.034719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1103/2199] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:41 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:57:42.505338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:42.505963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:42.512133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:42.513395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:42.514131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:42.514582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:42.572428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:42.581239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:42.582737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:42.583847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-842ad003-0556-4607-9c14-1b844fd3e21e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082261 Nov 08 17:57:42.584402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1097/2200] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:43.048768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5fc57224-6eeb-4db1-beec-79aa02e74b48 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:43.049384 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5fc57224-6eeb-4db1-beec-79aa02e74b48 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:43.055652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fc57224-6eeb-4db1-beec-79aa02e74b48 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:43.056099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fc57224-6eeb-4db1-beec-79aa02e74b48 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:43.056868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fc57224-6eeb-4db1-beec-79aa02e74b48 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:43.057302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5fc57224-6eeb-4db1-beec-79aa02e74b48 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:43.186270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5fc57224-6eeb-4db1-beec-79aa02e74b48 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:43.193932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5fc57224-6eeb-4db1-beec-79aa02e74b48 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149040 Nov 08 17:57:43.194504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1104/2201] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:43 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:43.601044 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:43.601680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:43.608667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:43.609124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:43.609880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:43.610304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:43.667891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:43.676534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:43.678012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:43.679174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-32974ecd-09c0-4d53-a353-bad0864994e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082053 Nov 08 17:57:43.679721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1098/2202] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:44.210673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-44611631-4c78-48e8-a55e-8c8c59366a77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:44.211305 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-44611631-4c78-48e8-a55e-8c8c59366a77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:44.217420 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-44611631-4c78-48e8-a55e-8c8c59366a77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:44.217858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-44611631-4c78-48e8-a55e-8c8c59366a77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:44.218650 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-44611631-4c78-48e8-a55e-8c8c59366a77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:44.219071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-44611631-4c78-48e8-a55e-8c8c59366a77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:44.344344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-44611631-4c78-48e8-a55e-8c8c59366a77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:44.352183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-44611631-4c78-48e8-a55e-8c8c59366a77 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145133 Nov 08 17:57:44.353007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1105/2203] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:44 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:44.697254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:44.697863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:44.704651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:44.705100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:44.705872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:44.706304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:44.765333 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:44.773335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:44.774836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:44.775952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a4f2f86d-cbec-4ff7-b1ba-bd38843c7ef3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082436 Nov 08 17:57:44.776503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1099/2204] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:45.368911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-aa9e3456-44dd-4c95-92c6-cd90793a6dcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:45.369529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-aa9e3456-44dd-4c95-92c6-cd90793a6dcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:45.376374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aa9e3456-44dd-4c95-92c6-cd90793a6dcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:45.376815 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aa9e3456-44dd-4c95-92c6-cd90793a6dcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:45.377572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aa9e3456-44dd-4c95-92c6-cd90793a6dcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:45.377999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aa9e3456-44dd-4c95-92c6-cd90793a6dcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:45.506406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-aa9e3456-44dd-4c95-92c6-cd90793a6dcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:45.514030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-aa9e3456-44dd-4c95-92c6-cd90793a6dcd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148767 Nov 08 17:57:45.514633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1106/2205] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:45 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:45.792984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:45.794188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:45.800341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:45.800792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:45.801567 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:45.802005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:45.860336 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:45.868431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:45.869936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:45.871096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-30d6b7ce-0606-478f-b547-8cacd50eeea5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081901 Nov 08 17:57:45.871811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1100/2206] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:46.530825 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ea431a25-52e4-4892-bd26-8b856623ad3d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:46.531414 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ea431a25-52e4-4892-bd26-8b856623ad3d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:46.537638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea431a25-52e4-4892-bd26-8b856623ad3d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:46.538086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea431a25-52e4-4892-bd26-8b856623ad3d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:46.538879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea431a25-52e4-4892-bd26-8b856623ad3d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:46.539316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ea431a25-52e4-4892-bd26-8b856623ad3d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:46.664256 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ea431a25-52e4-4892-bd26-8b856623ad3d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:46.672459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ea431a25-52e4-4892-bd26-8b856623ad3d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145740 Nov 08 17:57:46.673023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1107/2207] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:46 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:57:46.889195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:46.889827 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:46.896075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:46.896522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:46.897290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:46.897720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:46.959836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:46.968261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:46.969757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:46.970918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dff2967f-2f60-4627-a862-0532f079cd7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085562 Nov 08 17:57:46.971470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1101/2208] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:47.689005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f90fdc64-2eae-4936-b0dd-2a65c09514aa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:47.689628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f90fdc64-2eae-4936-b0dd-2a65c09514aa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:47.695785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f90fdc64-2eae-4936-b0dd-2a65c09514aa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:47.696223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f90fdc64-2eae-4936-b0dd-2a65c09514aa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:47.696983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f90fdc64-2eae-4936-b0dd-2a65c09514aa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:47.697411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f90fdc64-2eae-4936-b0dd-2a65c09514aa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:47.826013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f90fdc64-2eae-4936-b0dd-2a65c09514aa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:47.833675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f90fdc64-2eae-4936-b0dd-2a65c09514aa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148350 Nov 08 17:57:47.834242 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1108/2209] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:47 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:47.989353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:47.989874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:47.996355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:47.997905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:47.997905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:47.998109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:48.057017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:48.065150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:48.066682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:48.067805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9a6f7a46-6967-4f67-b36e-7d492cacd312 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082226 Nov 08 17:57:48.068355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1102/2210] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:48.851015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a0d42fa4-202c-44cb-9dca-bccffe474686 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:48.851653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a0d42fa4-202c-44cb-9dca-bccffe474686 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:48.858255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a0d42fa4-202c-44cb-9dca-bccffe474686 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:48.858725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a0d42fa4-202c-44cb-9dca-bccffe474686 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:48.859492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a0d42fa4-202c-44cb-9dca-bccffe474686 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:48.859921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a0d42fa4-202c-44cb-9dca-bccffe474686 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:48.987568 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a0d42fa4-202c-44cb-9dca-bccffe474686 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:48.995307 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a0d42fa4-202c-44cb-9dca-bccffe474686 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147935 Nov 08 17:57:49.003951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1109/2211] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:48 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:49.084819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:49.085413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:49.091822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:49.092258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:49.093025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:49.093451 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:49.152993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:49.163048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:49.165335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:49.166807 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8d2dbe62-e27b-4708-bdfd-54a76005f5c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085631 Nov 08 17:57:49.167361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1103/2212] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:50.019177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-22c23bf8-9d49-4e59-9d4a-22d891ba68e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:50.019779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-22c23bf8-9d49-4e59-9d4a-22d891ba68e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:50.026093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22c23bf8-9d49-4e59-9d4a-22d891ba68e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:50.029267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22c23bf8-9d49-4e59-9d4a-22d891ba68e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:50.029267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22c23bf8-9d49-4e59-9d4a-22d891ba68e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:50.029267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22c23bf8-9d49-4e59-9d4a-22d891ba68e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:50.154803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-22c23bf8-9d49-4e59-9d4a-22d891ba68e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:50.162318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-22c23bf8-9d49-4e59-9d4a-22d891ba68e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146944 Nov 08 17:57:50.163322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1110/2213] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:50 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:50.187837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:50.188443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:50.194618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:50.195056 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:50.195825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:50.196253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:50.253837 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:50.261756 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:50.263971 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:50.265087 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cff92e6b-a672-4a62-a501-5216d6bd0384 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081654 Nov 08 17:57:50.265641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1104/2214] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:51.179091 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2fb84aa8-604d-4877-bc10-9ee7ef3b11fa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:51.179647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2fb84aa8-604d-4877-bc10-9ee7ef3b11fa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:51.185795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fb84aa8-604d-4877-bc10-9ee7ef3b11fa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:51.186227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fb84aa8-604d-4877-bc10-9ee7ef3b11fa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:51.187015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fb84aa8-604d-4877-bc10-9ee7ef3b11fa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:51.187446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fb84aa8-604d-4877-bc10-9ee7ef3b11fa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:51.282401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:51.283090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:51.289269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:51.289715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:51.290529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:51.290967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:51.316797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2fb84aa8-604d-4877-bc10-9ee7ef3b11fa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:51.325369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2fb84aa8-604d-4877-bc10-9ee7ef3b11fa tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149332 Nov 08 17:57:51.326271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1111/2215] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:51 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:51.349345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:51.357796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:51.359307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:51.360420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-16bdecfc-9575-4c36-89b6-5617f2510b4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081682 Nov 08 17:57:51.360978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1105/2216] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:52.342924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-90575ce8-1181-42d2-af19-626d99f73410 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:52.343493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-90575ce8-1181-42d2-af19-626d99f73410 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:52.349818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90575ce8-1181-42d2-af19-626d99f73410 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:52.350264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90575ce8-1181-42d2-af19-626d99f73410 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:52.351069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90575ce8-1181-42d2-af19-626d99f73410 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:52.351502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90575ce8-1181-42d2-af19-626d99f73410 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:52.378073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:52.378762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:52.385056 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:52.385566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:52.386397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:52.386872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:52.447419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:52.455572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:52.457048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:52.458173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-500179f7-68b6-45cf-a898-07e8cb0f3718 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083790 Nov 08 17:57:52.458757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1106/2217] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:52.507125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-90575ce8-1181-42d2-af19-626d99f73410 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:52.515166 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-90575ce8-1181-42d2-af19-626d99f73410 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.176657 Nov 08 17:57:52.515737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1112/2218] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:52 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:53.476415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:53.477018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:53.484867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:53.485316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:53.486136 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:53.486598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:53.532214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-77c823b2-bdd5-43b4-9f08-c1be031a94c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:53.532813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-77c823b2-bdd5-43b4-9f08-c1be031a94c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:53.539126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77c823b2-bdd5-43b4-9f08-c1be031a94c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:53.539573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77c823b2-bdd5-43b4-9f08-c1be031a94c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:53.540370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77c823b2-bdd5-43b4-9f08-c1be031a94c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:53.540845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-77c823b2-bdd5-43b4-9f08-c1be031a94c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:53.547092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:53.555189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:53.556693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:53.557824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6c3b1860-0e87-4c4f-9b10-b6e40e9b4fc3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085123 Nov 08 17:57:53.558386 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1107/2219] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:53.669757 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-77c823b2-bdd5-43b4-9f08-c1be031a94c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:53.677483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-77c823b2-bdd5-43b4-9f08-c1be031a94c4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148934 Nov 08 17:57:53.678043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1113/2220] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:53 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:57:54.576348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:54.576961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:54.583378 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:54.583834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:54.584608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:54.585045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:54.644417 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:54.652642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:54.654152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:54.655400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7ad28239-3035-4c32-8da5-ff5f5a713e62 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083550 Nov 08 17:57:54.655972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1108/2221] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:54.694990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-86aa1d96-ad43-41b2-9fd0-4a8e82702c61 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:54.695643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-86aa1d96-ad43-41b2-9fd0-4a8e82702c61 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:54.702647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86aa1d96-ad43-41b2-9fd0-4a8e82702c61 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:54.703085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86aa1d96-ad43-41b2-9fd0-4a8e82702c61 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:54.703846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86aa1d96-ad43-41b2-9fd0-4a8e82702c61 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:54.704272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86aa1d96-ad43-41b2-9fd0-4a8e82702c61 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:54.833150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-86aa1d96-ad43-41b2-9fd0-4a8e82702c61 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:54.840883 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-86aa1d96-ad43-41b2-9fd0-4a8e82702c61 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149465 Nov 08 17:57:54.841441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1114/2222] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:54 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:55.673584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:55.674176 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:55.680391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:55.680836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:55.681589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:55.682015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:55.740897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:55.749181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:55.750698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:55.751920 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d1bd3881-f4a7-4382-ab1c-5434d18503d9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082119 Nov 08 17:57:55.752457 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1109/2223] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:57:55.857256 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-78513937-8462-41f7-baf8-e43e06885c30 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:55.857890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-78513937-8462-41f7-baf8-e43e06885c30 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:55.864192 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-78513937-8462-41f7-baf8-e43e06885c30 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:55.864635 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-78513937-8462-41f7-baf8-e43e06885c30 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:55.865402 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-78513937-8462-41f7-baf8-e43e06885c30 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:55.865831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-78513937-8462-41f7-baf8-e43e06885c30 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:55.990892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-78513937-8462-41f7-baf8-e43e06885c30 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:55.998908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-78513937-8462-41f7-baf8-e43e06885c30 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145345 Nov 08 17:57:56.002035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1115/2224] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:55 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:56.770370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:56.771006 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:56.777319 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:56.778494 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:56.779267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:56.779702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:56.841272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:56.849453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:56.850979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:56.852108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3392e95c-fdf9-4e2f-9adc-49213274af80 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085441 Nov 08 17:57:56.852997 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1110/2225] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:57.016547 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0283f504-9c4a-471e-a273-b6ba6cfcd000 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:57.017159 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0283f504-9c4a-471e-a273-b6ba6cfcd000 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:57.025331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0283f504-9c4a-471e-a273-b6ba6cfcd000 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:57.025331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0283f504-9c4a-471e-a273-b6ba6cfcd000 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:57.025331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0283f504-9c4a-471e-a273-b6ba6cfcd000 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:57.025331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0283f504-9c4a-471e-a273-b6ba6cfcd000 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:57.151507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0283f504-9c4a-471e-a273-b6ba6cfcd000 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:57.159237 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0283f504-9c4a-471e-a273-b6ba6cfcd000 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147302 Nov 08 17:57:57.159801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1116/2226] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:57 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:57.869619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:57.870210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:57.876671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:57.877115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:57.877878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:57.878342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:57.936290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:57.944313 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:57.945805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:57.946968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-89c31e4b-df8d-4afe-9b29-ce375cc06417 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081106 Nov 08 17:57:57.947524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1111/2227] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:58.176620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1bb53e03-af2f-400b-9465-ee30cf8225b2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:58.177138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1bb53e03-af2f-400b-9465-ee30cf8225b2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:58.183348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1bb53e03-af2f-400b-9465-ee30cf8225b2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:58.183782 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1bb53e03-af2f-400b-9465-ee30cf8225b2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:58.184537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1bb53e03-af2f-400b-9465-ee30cf8225b2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:58.184963 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1bb53e03-af2f-400b-9465-ee30cf8225b2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:58.316671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1bb53e03-af2f-400b-9465-ee30cf8225b2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:58.324305 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1bb53e03-af2f-400b-9465-ee30cf8225b2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151365 Nov 08 17:57:58.325459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1117/2228] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:58 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:57:58.965276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:58.965875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:58.972115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:58.972553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:58.973310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:58.973735 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:59.032017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:59.040059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:59.041763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:59.042918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8457a796-0e7f-4948-88d9-64a38af401cb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081328 Nov 08 17:57:59.043999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1112/2229] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:57:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:57:59.341313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-02caa587-3b35-449a-b44d-473e8235faa6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:57:59.341859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-02caa587-3b35-449a-b44d-473e8235faa6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:57:59.348097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02caa587-3b35-449a-b44d-473e8235faa6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:59.348534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02caa587-3b35-449a-b44d-473e8235faa6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:59.349288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02caa587-3b35-449a-b44d-473e8235faa6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:57:59.349709 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02caa587-3b35-449a-b44d-473e8235faa6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:57:59.477660 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-02caa587-3b35-449a-b44d-473e8235faa6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:57:59.485546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-02caa587-3b35-449a-b44d-473e8235faa6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148430 Nov 08 17:57:59.486099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1118/2230] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:57:59 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:00.061673 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:00.062275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:00.068531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:00.068977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:00.069737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:00.070202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:00.129114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:00.138305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:00.139853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:00.140981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aae42612-5ed6-4ee1-8612-184d752e873a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083792 Nov 08 17:58:00.141534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1113/2231] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:00.502269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c976e436-5978-4abc-ab11-2f0f184a4c3b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:00.502902 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c976e436-5978-4abc-ab11-2f0f184a4c3b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:00.509093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c976e436-5978-4abc-ab11-2f0f184a4c3b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:00.509533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c976e436-5978-4abc-ab11-2f0f184a4c3b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:00.510289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c976e436-5978-4abc-ab11-2f0f184a4c3b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:00.510746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c976e436-5978-4abc-ab11-2f0f184a4c3b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:00.638564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c976e436-5978-4abc-ab11-2f0f184a4c3b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:00.646240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c976e436-5978-4abc-ab11-2f0f184a4c3b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147580 Nov 08 17:58:00.646828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1119/2232] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:00 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:01.162145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:01.162742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:01.169363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:01.169811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:01.170617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:01.171058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:01.229866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:01.238504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:01.240110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:01.241231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c4e8a13c-553c-43a8-8ea3-aa3cf6fae0fe tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082842 Nov 08 17:58:01.241793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1114/2233] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:01.663369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a2b4144b-e045-45db-bd86-0edafdc1db69 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:01.664004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a2b4144b-e045-45db-bd86-0edafdc1db69 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:01.670983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a2b4144b-e045-45db-bd86-0edafdc1db69 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:01.671427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a2b4144b-e045-45db-bd86-0edafdc1db69 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:01.672216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a2b4144b-e045-45db-bd86-0edafdc1db69 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:01.672631 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a2b4144b-e045-45db-bd86-0edafdc1db69 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:01.797821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a2b4144b-e045-45db-bd86-0edafdc1db69 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:01.805345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a2b4144b-e045-45db-bd86-0edafdc1db69 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145616 Nov 08 17:58:01.805903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1120/2234] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:01 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:02.259611 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:02.260148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:02.267587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:02.268029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:02.268792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:02.269218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:02.330772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:02.339023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:02.341040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:02.342152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e1458722-d659-4c0f-a48a-a0efbe8f0b1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086318 Nov 08 17:58:02.342739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1115/2235] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:02.823118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-22d4e1ea-e04e-4eb3-ba81-6643e9da9de7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:02.823765 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-22d4e1ea-e04e-4eb3-ba81-6643e9da9de7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:02.830833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22d4e1ea-e04e-4eb3-ba81-6643e9da9de7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:02.831281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22d4e1ea-e04e-4eb3-ba81-6643e9da9de7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:02.832060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22d4e1ea-e04e-4eb3-ba81-6643e9da9de7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:02.832490 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22d4e1ea-e04e-4eb3-ba81-6643e9da9de7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:02.962272 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-22d4e1ea-e04e-4eb3-ba81-6643e9da9de7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:02.970749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-22d4e1ea-e04e-4eb3-ba81-6643e9da9de7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151237 Nov 08 17:58:02.971321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1121/2236] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:02 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:03.360801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:03.361413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:03.367626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:03.368071 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:03.368868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:03.369327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:03.426898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:03.435583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:03.437079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:03.438198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-11e8ce27-1df8-4518-96f7-b984d650e532 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081076 Nov 08 17:58:03.438786 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1116/2237] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:03.988808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cb43c9ae-50e0-45d8-8a70-3dbb540ac6ca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:03.989394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cb43c9ae-50e0-45d8-8a70-3dbb540ac6ca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:03.995755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb43c9ae-50e0-45d8-8a70-3dbb540ac6ca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:03.996198 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb43c9ae-50e0-45d8-8a70-3dbb540ac6ca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:03.998507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb43c9ae-50e0-45d8-8a70-3dbb540ac6ca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:03.998507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb43c9ae-50e0-45d8-8a70-3dbb540ac6ca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:04.130726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cb43c9ae-50e0-45d8-8a70-3dbb540ac6ca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:04.139683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cb43c9ae-50e0-45d8-8a70-3dbb540ac6ca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154547 Nov 08 17:58:04.140314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1122/2238] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:03 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:04.455862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:04.456501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:04.462805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:04.463253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:04.464031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:04.464469 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:04.522526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:04.530860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:04.532361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:04.533530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-216cf15b-217b-4ebb-9a4e-8e42a3a43a73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081339 Nov 08 17:58:04.534090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1117/2239] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:05.156867 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-98a3ec72-9cc7-4c16-a84f-c8ab6425dec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:05.157508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-98a3ec72-9cc7-4c16-a84f-c8ab6425dec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:05.163721 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-98a3ec72-9cc7-4c16-a84f-c8ab6425dec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:05.164172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-98a3ec72-9cc7-4c16-a84f-c8ab6425dec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:05.164934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-98a3ec72-9cc7-4c16-a84f-c8ab6425dec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:05.165363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-98a3ec72-9cc7-4c16-a84f-c8ab6425dec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:05.292823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-98a3ec72-9cc7-4c16-a84f-c8ab6425dec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:05.301288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-98a3ec72-9cc7-4c16-a84f-c8ab6425dec1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147971 Nov 08 17:58:05.301809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1123/2240] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:05 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:05.550756 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:05.551419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:05.557547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:05.557988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:05.558776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:05.559202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:05.617439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:05.625640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:05.627167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:05.628280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-994903ea-4937-4a1c-b072-dea726b7177e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081209 Nov 08 17:58:05.628826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1118/2241] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:06.317859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-38c885f7-bd6c-461d-a1c0-b9275b73a141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:06.318481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-38c885f7-bd6c-461d-a1c0-b9275b73a141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:06.325217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38c885f7-bd6c-461d-a1c0-b9275b73a141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:06.325653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38c885f7-bd6c-461d-a1c0-b9275b73a141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:06.326404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38c885f7-bd6c-461d-a1c0-b9275b73a141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:06.326858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-38c885f7-bd6c-461d-a1c0-b9275b73a141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:06.645737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:06.646366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:06.653435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:06.653820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:06.654625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:06.655060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:06.721660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:06.730007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:06.732391 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:06.733355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-38c885f7-bd6c-461d-a1c0-b9275b73a141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:06.733525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-296a8745-b8cb-427d-a051-58c825c82e8e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.091519 Nov 08 17:58:06.734086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1119/2242] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:06.741206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-38c885f7-bd6c-461d-a1c0-b9275b73a141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.426931 Nov 08 17:58:06.741785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1124/2243] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:06 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:07.752018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:07.752616 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:07.756558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-61822869-5436-49f6-8e57-273497c34d9f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:07.757170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-61822869-5436-49f6-8e57-273497c34d9f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:07.758869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:07.759310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:07.760080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:07.760508 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:07.763417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61822869-5436-49f6-8e57-273497c34d9f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:07.763857 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61822869-5436-49f6-8e57-273497c34d9f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:07.764626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61822869-5436-49f6-8e57-273497c34d9f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:07.765057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-61822869-5436-49f6-8e57-273497c34d9f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:07.836695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:07.845065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:07.846569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:07.847730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-80cbfb7d-20aa-408c-a05a-3cdcbdd4b454 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.099497 Nov 08 17:58:07.848279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1120/2244] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:07.909712 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-61822869-5436-49f6-8e57-273497c34d9f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:07.917417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-61822869-5436-49f6-8e57-273497c34d9f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.164458 Nov 08 17:58:07.918053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1125/2245] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:07 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:58:08.866863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:08.867450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:08.873709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:08.874149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:08.874982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:08.875418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:08.933741 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:08.934369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4dd3e807-7796-4f5e-80f6-5e7ac60dff16 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:08.935069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4dd3e807-7796-4f5e-80f6-5e7ac60dff16 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:08.941509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4dd3e807-7796-4f5e-80f6-5e7ac60dff16 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:08.942023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4dd3e807-7796-4f5e-80f6-5e7ac60dff16 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:08.942154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:08.942886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4dd3e807-7796-4f5e-80f6-5e7ac60dff16 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:08.943312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4dd3e807-7796-4f5e-80f6-5e7ac60dff16 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:08.943672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:08.944793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5138f992-1656-473b-92b1-43533dbc8b4f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081630 Nov 08 17:58:08.945354 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1121/2246] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:58:09.069965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4dd3e807-7796-4f5e-80f6-5e7ac60dff16 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:09.077983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4dd3e807-7796-4f5e-80f6-5e7ac60dff16 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148000 Nov 08 17:58:09.078562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1126/2247] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:08 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:58:09.962904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:09.963530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:09.969931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:09.970371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:09.971167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:09.971598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:10.031205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:10.039384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:10.040867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:10.041988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-07fcc096-9d4e-4970-8107-fb19027c78a8 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082787 Nov 08 17:58:10.042572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1122/2248] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:10.094123 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6af89c3f-58b0-442c-bc59-dd53ef8b0a7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:10.094792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6af89c3f-58b0-442c-bc59-dd53ef8b0a7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:10.100921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6af89c3f-58b0-442c-bc59-dd53ef8b0a7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:10.101364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6af89c3f-58b0-442c-bc59-dd53ef8b0a7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:10.102378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6af89c3f-58b0-442c-bc59-dd53ef8b0a7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:10.102835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6af89c3f-58b0-442c-bc59-dd53ef8b0a7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:10.230976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6af89c3f-58b0-442c-bc59-dd53ef8b0a7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:10.238562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6af89c3f-58b0-442c-bc59-dd53ef8b0a7f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148010 Nov 08 17:58:10.239120 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1127/2249] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:10 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:58:11.060838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:11.061437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:11.067660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:11.068109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:11.068875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:11.069310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:11.126660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:11.134742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:11.136245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:11.138038 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b18f2846-bada-48b1-b070-d851dfa19b86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081426 Nov 08 17:58:11.138612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1123/2250] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:11.255922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7f215c98-02dc-4570-9812-72d7da81c7ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:11.256477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7f215c98-02dc-4570-9812-72d7da81c7ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:11.263411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7f215c98-02dc-4570-9812-72d7da81c7ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:11.263847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7f215c98-02dc-4570-9812-72d7da81c7ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:11.264606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7f215c98-02dc-4570-9812-72d7da81c7ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:11.265029 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7f215c98-02dc-4570-9812-72d7da81c7ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:11.391764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7f215c98-02dc-4570-9812-72d7da81c7ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:11.399385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7f215c98-02dc-4570-9812-72d7da81c7ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147182 Nov 08 17:58:11.400087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1128/2251] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:11 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:12.156180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:12.156779 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:12.162973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:12.163412 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:12.164171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:12.164594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:12.225365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:12.233751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:12.235264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:12.236371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f250be3d-95a3-4cbf-89fb-67196ce52130 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084365 Nov 08 17:58:12.236923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1124/2252] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:12.416098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-34c8245e-da44-4416-b24c-ac5e36a49595 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:12.416727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-34c8245e-da44-4416-b24c-ac5e36a49595 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:12.422948 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34c8245e-da44-4416-b24c-ac5e36a49595 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:12.428672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34c8245e-da44-4416-b24c-ac5e36a49595 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:12.428672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34c8245e-da44-4416-b24c-ac5e36a49595 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:12.428672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-34c8245e-da44-4416-b24c-ac5e36a49595 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:12.624400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-34c8245e-da44-4416-b24c-ac5e36a49595 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:12.624400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-34c8245e-da44-4416-b24c-ac5e36a49595 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155102 Nov 08 17:58:12.624400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1129/2253] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:12 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:13.254350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:13.254942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:13.260928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:13.261884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:13.262847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:13.263309 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:13.322188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:13.332918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:13.334405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:13.335594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d1d4389e-06be-48db-b7aa-f2ac34aa2c57 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085090 Nov 08 17:58:13.336281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1125/2254] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:13.585133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1fd19645-76d2-4b27-a9af-a0808d76e4c0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:13.585786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1fd19645-76d2-4b27-a9af-a0808d76e4c0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:13.592170 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1fd19645-76d2-4b27-a9af-a0808d76e4c0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:13.592698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1fd19645-76d2-4b27-a9af-a0808d76e4c0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:13.593497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1fd19645-76d2-4b27-a9af-a0808d76e4c0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:13.593927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1fd19645-76d2-4b27-a9af-a0808d76e4c0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:13.740266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1fd19645-76d2-4b27-a9af-a0808d76e4c0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:13.749514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1fd19645-76d2-4b27-a9af-a0808d76e4c0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.168124 Nov 08 17:58:13.750084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1130/2255] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:13 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:14.355143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:14.356701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:14.362393 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:14.362864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:14.363660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:14.364091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:14.421622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:14.429761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:14.431291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:14.432413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-984ea181-442e-4aaa-abca-ca080b1ed846 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081399 Nov 08 17:58:14.432967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1126/2256] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:14.768443 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-94f748f8-2c59-41fd-a5cf-83d5c2a9fb4a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:14.769028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-94f748f8-2c59-41fd-a5cf-83d5c2a9fb4a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:14.774915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94f748f8-2c59-41fd-a5cf-83d5c2a9fb4a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:14.786039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94f748f8-2c59-41fd-a5cf-83d5c2a9fb4a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:14.786039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94f748f8-2c59-41fd-a5cf-83d5c2a9fb4a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:14.786039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-94f748f8-2c59-41fd-a5cf-83d5c2a9fb4a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:14.902846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-94f748f8-2c59-41fd-a5cf-83d5c2a9fb4a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:14.910538 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-94f748f8-2c59-41fd-a5cf-83d5c2a9fb4a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145709 Nov 08 17:58:14.911094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1131/2257] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:14 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:15.449613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:15.450212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:15.456448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:15.456866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:15.457628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:15.458055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:15.516665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:15.524748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:15.526223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:15.527369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d852fefd-a396-4226-b969-f75430f932b7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081606 Nov 08 17:58:15.528076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1127/2258] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:15.927320 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0b09b7d4-40c3-45a6-92d3-4b15e172e30c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:15.928958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0b09b7d4-40c3-45a6-92d3-4b15e172e30c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:15.934165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b09b7d4-40c3-45a6-92d3-4b15e172e30c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:15.934646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b09b7d4-40c3-45a6-92d3-4b15e172e30c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:15.935406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b09b7d4-40c3-45a6-92d3-4b15e172e30c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:15.935831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b09b7d4-40c3-45a6-92d3-4b15e172e30c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:16.064894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0b09b7d4-40c3-45a6-92d3-4b15e172e30c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:16.072571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0b09b7d4-40c3-45a6-92d3-4b15e172e30c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148957 Nov 08 17:58:16.073125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1132/2259] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:15 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:16.544985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:16.545605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:16.551841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:16.552282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:16.553075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:16.553505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:16.612331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:16.620523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:16.622663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:16.623783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-73af0edf-aa5b-4544-ab7f-f416ac0113bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082653 Nov 08 17:58:16.624337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1128/2260] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:17.090711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-166e66d6-a1c2-4695-97ae-c935ed131cca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:17.091333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-166e66d6-a1c2-4695-97ae-c935ed131cca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:17.097464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-166e66d6-a1c2-4695-97ae-c935ed131cca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:17.097909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-166e66d6-a1c2-4695-97ae-c935ed131cca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:17.098705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-166e66d6-a1c2-4695-97ae-c935ed131cca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:17.099137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-166e66d6-a1c2-4695-97ae-c935ed131cca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:17.226823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-166e66d6-a1c2-4695-97ae-c935ed131cca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:17.235317 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-166e66d6-a1c2-4695-97ae-c935ed131cca tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148790 Nov 08 17:58:17.235876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1133/2261] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:17 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:17.642409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:17.643021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:17.649159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:17.649596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:17.650974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:17.651409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:17.711763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:17.720537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:17.722016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:17.723149 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c7924eec-2344-4721-b33f-7ad3a4b44c9d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084523 Nov 08 17:58:17.723702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1129/2262] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:18.251927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b36439b7-6eb4-4b1d-80cc-5f606603d751 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:18.252467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b36439b7-6eb4-4b1d-80cc-5f606603d751 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:18.258667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b36439b7-6eb4-4b1d-80cc-5f606603d751 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:18.259106 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b36439b7-6eb4-4b1d-80cc-5f606603d751 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:18.259888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b36439b7-6eb4-4b1d-80cc-5f606603d751 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:18.260314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b36439b7-6eb4-4b1d-80cc-5f606603d751 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:18.385232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b36439b7-6eb4-4b1d-80cc-5f606603d751 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:18.393354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b36439b7-6eb4-4b1d-80cc-5f606603d751 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145090 Nov 08 17:58:18.393912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1134/2263] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:18 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:18.741933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:18.742613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:18.749499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:18.749979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:18.750757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:18.751182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:18.807990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:18.816513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:18.817999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:18.819144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e5fbad5f-61b7-4f88-8999-7ba406de978d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080895 Nov 08 17:58:18.819699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1130/2264] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:19.410747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0d1e32cb-2475-465d-abb6-ccb44176959c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:19.411348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0d1e32cb-2475-465d-abb6-ccb44176959c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:19.417715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0d1e32cb-2475-465d-abb6-ccb44176959c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:19.418204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0d1e32cb-2475-465d-abb6-ccb44176959c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:19.419033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0d1e32cb-2475-465d-abb6-ccb44176959c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:19.420062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0d1e32cb-2475-465d-abb6-ccb44176959c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:19.550243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0d1e32cb-2475-465d-abb6-ccb44176959c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:19.557932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0d1e32cb-2475-465d-abb6-ccb44176959c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150848 Nov 08 17:58:19.558511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1135/2265] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:19 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:19.843014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:19.843014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:19.845521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:19.845973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:19.846818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:19.847252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:19.904651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:19.913545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:19.915078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:19.916201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fe3b1f39-fc5e-48ad-879b-83c619be09c1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082455 Nov 08 17:58:19.916754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1131/2266] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:20.574680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bae39469-1a98-418b-8f8c-42f4d7bce93f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:20.575269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bae39469-1a98-418b-8f8c-42f4d7bce93f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:20.581529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bae39469-1a98-418b-8f8c-42f4d7bce93f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:20.581967 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bae39469-1a98-418b-8f8c-42f4d7bce93f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:20.582759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bae39469-1a98-418b-8f8c-42f4d7bce93f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:20.583180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bae39469-1a98-418b-8f8c-42f4d7bce93f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:20.708599 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bae39469-1a98-418b-8f8c-42f4d7bce93f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:20.716337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bae39469-1a98-418b-8f8c-42f4d7bce93f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145324 Nov 08 17:58:20.716899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1136/2267] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:20 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:20.932756 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:20.933355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:20.939763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:20.940200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:20.940958 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:20.941385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:21.005132 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:21.008141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:21.009629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:21.010797 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fde50cf3-8896-44e2-89d3-8ec16c54b921 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081646 Nov 08 17:58:21.011372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1132/2268] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:21.733429 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0cf96985-81cd-459a-826c-7b52325ef387 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:21.734019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0cf96985-81cd-459a-826c-7b52325ef387 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:21.740417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0cf96985-81cd-459a-826c-7b52325ef387 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:21.740882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0cf96985-81cd-459a-826c-7b52325ef387 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:21.741641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0cf96985-81cd-459a-826c-7b52325ef387 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:21.742194 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0cf96985-81cd-459a-826c-7b52325ef387 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:21.872028 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0cf96985-81cd-459a-826c-7b52325ef387 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:21.880435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0cf96985-81cd-459a-826c-7b52325ef387 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150540 Nov 08 17:58:21.881006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1137/2269] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:21 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:22.028815 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:22.029397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:22.035940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:22.036379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:22.037142 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:22.037572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:22.095651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:22.103858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:22.105328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:22.106434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-600da60d-9e9c-4283-ab85-d25dbffaa002 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081420 Nov 08 17:58:22.107012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1133/2270] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:22.897665 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e3e0271c-31fd-4741-8d3b-75e7734b1eb2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:22.898250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e3e0271c-31fd-4741-8d3b-75e7734b1eb2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:22.904469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e3e0271c-31fd-4741-8d3b-75e7734b1eb2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:22.904907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e3e0271c-31fd-4741-8d3b-75e7734b1eb2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:22.905669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e3e0271c-31fd-4741-8d3b-75e7734b1eb2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:22.906095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e3e0271c-31fd-4741-8d3b-75e7734b1eb2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:23.034590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e3e0271c-31fd-4741-8d3b-75e7734b1eb2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:23.042672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e3e0271c-31fd-4741-8d3b-75e7734b1eb2 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148616 Nov 08 17:58:23.043235 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1138/2271] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:22 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:23.124281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:23.124889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:23.131932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:23.132370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:23.133194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:23.133622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:23.195449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:23.203389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:23.205429 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:23.206688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7dbad8e3-ceda-4e59-953b-41153881c6bd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086055 Nov 08 17:58:23.207243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1134/2272] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:24.059693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-990139d8-2261-4313-a0b7-7e02d98deddd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:24.060329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-990139d8-2261-4313-a0b7-7e02d98deddd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:24.067431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-990139d8-2261-4313-a0b7-7e02d98deddd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:24.067873 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-990139d8-2261-4313-a0b7-7e02d98deddd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:24.068636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-990139d8-2261-4313-a0b7-7e02d98deddd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:24.069065 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-990139d8-2261-4313-a0b7-7e02d98deddd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:24.196031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-990139d8-2261-4313-a0b7-7e02d98deddd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:24.203562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-990139d8-2261-4313-a0b7-7e02d98deddd tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147547 Nov 08 17:58:24.204119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1139/2273] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:24 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:24.224751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:24.225349 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:24.231730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:24.232166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:24.232928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:24.233357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:24.291103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:24.299924 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:24.301407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:24.302542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bd8764b6-16a8-4146-9e51-316bf982ab3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081416 Nov 08 17:58:24.303090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1135/2274] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:25.219668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d9aed599-b874-46f4-a0e0-254c02d32d12 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:25.220284 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d9aed599-b874-46f4-a0e0-254c02d32d12 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:25.226488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d9aed599-b874-46f4-a0e0-254c02d32d12 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:25.227203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d9aed599-b874-46f4-a0e0-254c02d32d12 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:25.227996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d9aed599-b874-46f4-a0e0-254c02d32d12 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:25.228421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d9aed599-b874-46f4-a0e0-254c02d32d12 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:25.321064 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:25.321670 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:25.327841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:25.328343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:25.329121 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:25.329552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:25.360278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d9aed599-b874-46f4-a0e0-254c02d32d12 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:25.368608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d9aed599-b874-46f4-a0e0-254c02d32d12 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152622 Nov 08 17:58:25.369185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1140/2275] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:25 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:25.388642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:25.396799 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:25.398330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:25.399503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-556b63a8-8499-4c30-96f0-aa789e53430f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082103 Nov 08 17:58:25.400056 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1136/2276] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:58:26.384659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a078401b-4707-4e22-871c-5da750d483e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:26.385273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a078401b-4707-4e22-871c-5da750d483e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:26.391595 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a078401b-4707-4e22-871c-5da750d483e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:26.392046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a078401b-4707-4e22-871c-5da750d483e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:26.392815 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a078401b-4707-4e22-871c-5da750d483e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:26.393283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a078401b-4707-4e22-871c-5da750d483e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:26.416993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:26.417689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:26.423930 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:26.424492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:26.425263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:26.426281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:26.490264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:26.498439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:26.499942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:26.501059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-591210b2-a912-4fbe-8512-0c058cb2193b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087728 Nov 08 17:58:26.501618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1137/2277] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:58:26.547302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a078401b-4707-4e22-871c-5da750d483e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:26.556037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a078401b-4707-4e22-871c-5da750d483e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.175146 Nov 08 17:58:26.556608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1141/2278] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:26 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:27.518997 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:27.519623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:27.526026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:27.526487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:27.527275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:27.527712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:27.573571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-17a1505c-4069-4608-a8a7-f9e5378d8c05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:27.574381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-17a1505c-4069-4608-a8a7-f9e5378d8c05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:27.580731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17a1505c-4069-4608-a8a7-f9e5378d8c05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:27.581167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17a1505c-4069-4608-a8a7-f9e5378d8c05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:27.581926 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17a1505c-4069-4608-a8a7-f9e5378d8c05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:27.582355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17a1505c-4069-4608-a8a7-f9e5378d8c05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:27.591261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:27.599384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:27.600881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:27.602268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-67e8127f-5978-4ddf-b6e7-db6a5d38d8e1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086701 Nov 08 17:58:27.603058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1138/2279] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:27.710934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-17a1505c-4069-4608-a8a7-f9e5378d8c05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:27.718565 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-17a1505c-4069-4608-a8a7-f9e5378d8c05 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148728 Nov 08 17:58:27.719134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1142/2280] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:27 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:58:28.620263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:28.620891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:28.627158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:28.627604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:28.628371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:28.628803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:28.687232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:28.695975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:28.697468 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:28.698624 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5de48e18-ea73-4cb0-b32c-286d6e13568b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082061 Nov 08 17:58:28.699183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1139/2281] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:28.735488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0b36e5d0-c80e-4ee3-9e9c-6e486ac26d74 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:28.736094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0b36e5d0-c80e-4ee3-9e9c-6e486ac26d74 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:28.742318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b36e5d0-c80e-4ee3-9e9c-6e486ac26d74 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:28.742782 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b36e5d0-c80e-4ee3-9e9c-6e486ac26d74 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:28.743539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b36e5d0-c80e-4ee3-9e9c-6e486ac26d74 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:28.743966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0b36e5d0-c80e-4ee3-9e9c-6e486ac26d74 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:28.872731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0b36e5d0-c80e-4ee3-9e9c-6e486ac26d74 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:28.882633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0b36e5d0-c80e-4ee3-9e9c-6e486ac26d74 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150659 Nov 08 17:58:28.883229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1143/2282] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:28 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:29.717226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:29.717818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:29.724628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:29.725066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:29.725826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:29.726248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:29.783802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:29.794866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:29.796358 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:29.797466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3cb2f286-dbee-43f3-9276-8ce3daeaa2be tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084056 Nov 08 17:58:29.798018 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1140/2283] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:29.898814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-916c458f-14b2-4418-8eda-ef6c246bb867 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:29.899426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-916c458f-14b2-4418-8eda-ef6c246bb867 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:29.905610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-916c458f-14b2-4418-8eda-ef6c246bb867 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:29.906057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-916c458f-14b2-4418-8eda-ef6c246bb867 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:29.906853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-916c458f-14b2-4418-8eda-ef6c246bb867 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:29.907288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-916c458f-14b2-4418-8eda-ef6c246bb867 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:30.034781 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-916c458f-14b2-4418-8eda-ef6c246bb867 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:30.043494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-916c458f-14b2-4418-8eda-ef6c246bb867 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148269 Nov 08 17:58:30.044200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1144/2284] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:29 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:30.815771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:30.816353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:30.823188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:30.823626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:30.824384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:30.824809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:30.882585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:30.890614 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:30.892126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:30.893240 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4ed6bb98-6043-45e7-baf2-ac59c6b5ca95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081131 Nov 08 17:58:30.893796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1141/2285] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:31.060871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7fd4b7ad-f1a7-4249-8af2-69ab6d5f9fc8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:31.061482 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7fd4b7ad-f1a7-4249-8af2-69ab6d5f9fc8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:31.067739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7fd4b7ad-f1a7-4249-8af2-69ab6d5f9fc8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:31.068125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7fd4b7ad-f1a7-4249-8af2-69ab6d5f9fc8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:31.069389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7fd4b7ad-f1a7-4249-8af2-69ab6d5f9fc8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:31.069815 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7fd4b7ad-f1a7-4249-8af2-69ab6d5f9fc8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:31.198768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7fd4b7ad-f1a7-4249-8af2-69ab6d5f9fc8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:31.206346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7fd4b7ad-f1a7-4249-8af2-69ab6d5f9fc8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149146 Nov 08 17:58:31.206937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1145/2286] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:31 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:31.911443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:31.912051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:31.918205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:31.918678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:31.919443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:31.919870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:31.977563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:31.985511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:31.987025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:31.988154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ec32c890-8d95-44d4-ab93-9bc9a58e1f0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080370 Nov 08 17:58:31.988710 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1142/2287] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:32.223047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-73300191-7392-4c36-9b0d-86adebea0bf0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:32.223587 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-73300191-7392-4c36-9b0d-86adebea0bf0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:32.230668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73300191-7392-4c36-9b0d-86adebea0bf0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:32.231103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73300191-7392-4c36-9b0d-86adebea0bf0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:32.231860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73300191-7392-4c36-9b0d-86adebea0bf0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:32.232368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-73300191-7392-4c36-9b0d-86adebea0bf0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:32.358667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-73300191-7392-4c36-9b0d-86adebea0bf0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:32.366915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-73300191-7392-4c36-9b0d-86adebea0bf0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147509 Nov 08 17:58:32.367472 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1146/2288] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:32 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:33.007619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:33.008254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:33.014486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:33.020681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:33.020681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:33.020681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:33.074390 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:33.082598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:33.084819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:33.085960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-67723e13-ef95-47f8-b62a-5e732dc4618b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082690 Nov 08 17:58:33.086538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1143/2289] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:33.384304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2e407ca6-6033-4b13-9ea1-0311e5ea268a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:33.384909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2e407ca6-6033-4b13-9ea1-0311e5ea268a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:33.391289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e407ca6-6033-4b13-9ea1-0311e5ea268a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:33.391727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e407ca6-6033-4b13-9ea1-0311e5ea268a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:33.392483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e407ca6-6033-4b13-9ea1-0311e5ea268a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:33.392952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e407ca6-6033-4b13-9ea1-0311e5ea268a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:33.522562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2e407ca6-6033-4b13-9ea1-0311e5ea268a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:33.530138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2e407ca6-6033-4b13-9ea1-0311e5ea268a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150278 Nov 08 17:58:33.530798 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1147/2290] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:33 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:34.104355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:34.104958 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:34.111237 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:34.111681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:34.112447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:34.112909 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:34.171698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:34.180388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:34.186864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:34.186864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b6542667-6daf-4617-b019-b60fe0749a66 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082996 Nov 08 17:58:34.186864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1144/2291] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:34.546618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bba199d1-8a8d-40c8-80c4-c59cf8f8dd3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:34.547253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bba199d1-8a8d-40c8-80c4-c59cf8f8dd3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:34.554398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bba199d1-8a8d-40c8-80c4-c59cf8f8dd3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:34.554852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bba199d1-8a8d-40c8-80c4-c59cf8f8dd3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:34.555621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bba199d1-8a8d-40c8-80c4-c59cf8f8dd3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:34.556048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bba199d1-8a8d-40c8-80c4-c59cf8f8dd3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:34.682181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bba199d1-8a8d-40c8-80c4-c59cf8f8dd3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:34.689678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bba199d1-8a8d-40c8-80c4-c59cf8f8dd3c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146674 Nov 08 17:58:34.690237 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1148/2292] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:34 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:35.200547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:35.201150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:35.207570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:35.208015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:35.208781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:35.209370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:35.270985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:35.280283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:35.281778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:35.282935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-38bff008-4082-43a9-a8d9-ceaf440bd14b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086118 Nov 08 17:58:35.283481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1145/2293] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:35.706787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-159a81b3-6822-4d45-aed2-33571a76cf49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:35.724453 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-159a81b3-6822-4d45-aed2-33571a76cf49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:35.724453 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-159a81b3-6822-4d45-aed2-33571a76cf49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:35.724453 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-159a81b3-6822-4d45-aed2-33571a76cf49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:35.724453 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-159a81b3-6822-4d45-aed2-33571a76cf49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:35.724878 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-159a81b3-6822-4d45-aed2-33571a76cf49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:35.851053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-159a81b3-6822-4d45-aed2-33571a76cf49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:35.858899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-159a81b3-6822-4d45-aed2-33571a76cf49 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.156374 Nov 08 17:58:35.859461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1149/2294] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:35 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:36.301550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:36.302073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:36.309500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:36.309946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:36.310784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:36.311245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:36.370401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:36.378724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:36.380220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:36.381581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-73bd31ba-190b-48ad-aea1-726f25db0975 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084364 Nov 08 17:58:36.382172 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1146/2295] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:36.876161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9fe55eab-0a4c-4f90-861c-9c52bd60afe9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:36.876761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9fe55eab-0a4c-4f90-861c-9c52bd60afe9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:36.883993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fe55eab-0a4c-4f90-861c-9c52bd60afe9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:36.884411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fe55eab-0a4c-4f90-861c-9c52bd60afe9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:36.885168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fe55eab-0a4c-4f90-861c-9c52bd60afe9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:36.885592 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fe55eab-0a4c-4f90-861c-9c52bd60afe9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:37.015473 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9fe55eab-0a4c-4f90-861c-9c52bd60afe9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:37.023919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9fe55eab-0a4c-4f90-861c-9c52bd60afe9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151379 Nov 08 17:58:37.024481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1150/2296] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:36 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:37.400516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:37.401125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:37.407416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:37.407862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:37.408632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:37.409061 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:37.467772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:37.475888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:37.477637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:37.478821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-65ee5121-bcfe-4cc2-aaa8-cf04df54e531 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082554 Nov 08 17:58:37.479383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1147/2297] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:38.040826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b16e0892-1740-4dbb-8583-793f8d94ddaf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:38.041428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b16e0892-1740-4dbb-8583-793f8d94ddaf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:38.047703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b16e0892-1740-4dbb-8583-793f8d94ddaf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:38.048144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b16e0892-1740-4dbb-8583-793f8d94ddaf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:38.048900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b16e0892-1740-4dbb-8583-793f8d94ddaf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:38.049326 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b16e0892-1740-4dbb-8583-793f8d94ddaf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:38.174379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b16e0892-1740-4dbb-8583-793f8d94ddaf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:38.182931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b16e0892-1740-4dbb-8583-793f8d94ddaf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145753 Nov 08 17:58:38.183499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1151/2298] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:38 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:38.497034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:38.497570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:38.503878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:38.504323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:38.505090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:38.505524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:38.564041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:38.572489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:38.573987 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:38.575143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-da222a58-d7e8-4f5c-8f6f-04840319de36 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081850 Nov 08 17:58:38.575698 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1148/2299] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:39.200074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1f9f580f-4002-4970-9492-bed87cf6b378 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:39.200633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1f9f580f-4002-4970-9492-bed87cf6b378 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:39.206821 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f9f580f-4002-4970-9492-bed87cf6b378 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:39.207260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f9f580f-4002-4970-9492-bed87cf6b378 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:39.208023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f9f580f-4002-4970-9492-bed87cf6b378 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:39.208445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f9f580f-4002-4970-9492-bed87cf6b378 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:39.336917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1f9f580f-4002-4970-9492-bed87cf6b378 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:39.344437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1f9f580f-4002-4970-9492-bed87cf6b378 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148098 Nov 08 17:58:39.344992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1152/2300] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:39 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:39.593487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:39.594021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:39.600242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:39.600681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:39.601486 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:39.602168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:39.660415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:39.668928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:39.670407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:39.671543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-189281d0-7245-40c3-b0ca-0f8a349d024d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081796 Nov 08 17:58:39.672126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1149/2301] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:40.361117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bef13e41-a818-4bca-9090-271032f41ae9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:40.361667 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bef13e41-a818-4bca-9090-271032f41ae9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:40.368016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bef13e41-a818-4bca-9090-271032f41ae9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:40.368456 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bef13e41-a818-4bca-9090-271032f41ae9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:40.369223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bef13e41-a818-4bca-9090-271032f41ae9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:40.369654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bef13e41-a818-4bca-9090-271032f41ae9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:40.497213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bef13e41-a818-4bca-9090-271032f41ae9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:40.504826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bef13e41-a818-4bca-9090-271032f41ae9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147467 Nov 08 17:58:40.505381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1153/2302] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:40 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:40.688801 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:40.689382 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:40.695520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:40.695954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:40.696714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:40.697144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:40.758511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:40.766559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:40.768047 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:40.769161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-55eeefc5-ddac-4d96-b75b-630c50ac4bf7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084058 Nov 08 17:58:40.769704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1150/2303] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:58:41.523554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-29a9c53c-b307-4330-b785-3e7e6a97fe24 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:41.524279 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-29a9c53c-b307-4330-b785-3e7e6a97fe24 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:41.530654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29a9c53c-b307-4330-b785-3e7e6a97fe24 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:41.531098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29a9c53c-b307-4330-b785-3e7e6a97fe24 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:41.531871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29a9c53c-b307-4330-b785-3e7e6a97fe24 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:41.532312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-29a9c53c-b307-4330-b785-3e7e6a97fe24 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:41.659347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-29a9c53c-b307-4330-b785-3e7e6a97fe24 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:41.667802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-29a9c53c-b307-4330-b785-3e7e6a97fe24 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148662 Nov 08 17:58:41.668367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1154/2304] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:41 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:41.785897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:41.786454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:41.793245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:41.793685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:41.794445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:41.794891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:41.853916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:41.861892 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:41.863405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:41.864524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-06a38d72-1aba-4b9f-bce8-de2ea10a37ea tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082441 Nov 08 17:58:41.865080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1151/2305] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:42.685165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-37f21a94-bf34-4bd0-8093-1dfcc24a4c0b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:42.685785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-37f21a94-bf34-4bd0-8093-1dfcc24a4c0b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:42.692082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-37f21a94-bf34-4bd0-8093-1dfcc24a4c0b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:42.692529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-37f21a94-bf34-4bd0-8093-1dfcc24a4c0b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:42.693294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-37f21a94-bf34-4bd0-8093-1dfcc24a4c0b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:42.693730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-37f21a94-bf34-4bd0-8093-1dfcc24a4c0b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:42.821702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-37f21a94-bf34-4bd0-8093-1dfcc24a4c0b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:42.829327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-37f21a94-bf34-4bd0-8093-1dfcc24a4c0b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147834 Nov 08 17:58:42.829888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1155/2306] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:42 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:42.882151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:42.882771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:42.888459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:42.888898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:42.889655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:42.890081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:42.950518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:42.958569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:42.960119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:42.961407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8ade2cfa-27d8-45f9-b861-63423a4ca9c0 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083064 Nov 08 17:58:42.961963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1152/2307] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:43.845460 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-abed8d66-6860-46d5-8975-798d81b6de25 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:43.846059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-abed8d66-6860-46d5-8975-798d81b6de25 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:43.852671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abed8d66-6860-46d5-8975-798d81b6de25 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:43.853106 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abed8d66-6860-46d5-8975-798d81b6de25 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:43.853861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abed8d66-6860-46d5-8975-798d81b6de25 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:43.854286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abed8d66-6860-46d5-8975-798d81b6de25 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:43.979505 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:43.979983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-abed8d66-6860-46d5-8975-798d81b6de25 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:43.980125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:43.986293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:43.986774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:43.987556 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:43.987756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-abed8d66-6860-46d5-8975-798d81b6de25 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146089 Nov 08 17:58:43.994662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1156/2308] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:43 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:44.000874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:44.048179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:44.057053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:44.058583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:44.059713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-81dc7572-4516-40d8-9871-408a0df75fad tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084320 Nov 08 17:58:44.060275 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1153/2309] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:58:45.004971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-538f6d65-21e1-4613-bb38-cf1d64cb2c3a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:45.005582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-538f6d65-21e1-4613-bb38-cf1d64cb2c3a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:45.011605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-538f6d65-21e1-4613-bb38-cf1d64cb2c3a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:45.012050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-538f6d65-21e1-4613-bb38-cf1d64cb2c3a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:45.012933 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-538f6d65-21e1-4613-bb38-cf1d64cb2c3a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:45.013363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-538f6d65-21e1-4613-bb38-cf1d64cb2c3a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:45.078402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:45.079134 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:45.085253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:45.085703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:45.086502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:45.086943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:45.157746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:45.165484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-538f6d65-21e1-4613-bb38-cf1d64cb2c3a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:45.166485 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:45.167977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:45.169107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4f7a4e88-ed60-4f39-be13-a6d44a8b6f1d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.094376 Nov 08 17:58:45.169665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1154/2310] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:58:45.173298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-538f6d65-21e1-4613-bb38-cf1d64cb2c3a tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.171982 Nov 08 17:58:45.173792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1157/2311] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:45 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:46.187621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:46.188216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:46.190154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-132b43ed-9998-43f4-b6a1-75e328ce8565 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:46.190780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-132b43ed-9998-43f4-b6a1-75e328ce8565 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:46.195293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:46.195848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:46.196627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:46.197060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:46.197658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-132b43ed-9998-43f4-b6a1-75e328ce8565 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:46.198095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-132b43ed-9998-43f4-b6a1-75e328ce8565 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:46.198879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-132b43ed-9998-43f4-b6a1-75e328ce8565 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:46.199310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-132b43ed-9998-43f4-b6a1-75e328ce8565 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:46.274686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:46.283048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:46.284542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:46.285669 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b3ff970a-4310-4e0c-b601-a677d49e14af tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.101745 Nov 08 17:58:46.286252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1155/2312] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:46.347245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-132b43ed-9998-43f4-b6a1-75e328ce8565 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:46.355958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-132b43ed-9998-43f4-b6a1-75e328ce8565 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.169433 Nov 08 17:58:46.356528 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1158/2313] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:46 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:58:47.303586 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:47.304327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:47.310352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:47.310822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:47.311592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:47.312024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:47.371086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:47.373391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ead1bf7f-2f6a-431e-8e74-61285e29b97b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:47.374023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ead1bf7f-2f6a-431e-8e74-61285e29b97b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:47.379214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:47.380120 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ead1bf7f-2f6a-431e-8e74-61285e29b97b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:47.380563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ead1bf7f-2f6a-431e-8e74-61285e29b97b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:47.380745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:47.381322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ead1bf7f-2f6a-431e-8e74-61285e29b97b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:47.381749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ead1bf7f-2f6a-431e-8e74-61285e29b97b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:47.382383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-32cefff0-1fea-46e0-b230-b190644f1dbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082066 Nov 08 17:58:47.383242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1156/2314] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:47.509995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ead1bf7f-2f6a-431e-8e74-61285e29b97b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:47.517581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ead1bf7f-2f6a-431e-8e74-61285e29b97b tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147790 Nov 08 17:58:47.518144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1159/2315] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:47 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:58:48.400936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:48.401541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:48.407767 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:48.408214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:48.408979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:48.409414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:48.470658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:48.479660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:48.481154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:48.482272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b36eb832-1135-4651-8b42-02eba7572332 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085794 Nov 08 17:58:48.482850 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1157/2316] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:48.534845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0822515d-b5fe-4a0f-9499-1c9e78d5b0e8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:48.535560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0822515d-b5fe-4a0f-9499-1c9e78d5b0e8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:48.542441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0822515d-b5fe-4a0f-9499-1c9e78d5b0e8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:48.542914 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0822515d-b5fe-4a0f-9499-1c9e78d5b0e8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:48.543680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0822515d-b5fe-4a0f-9499-1c9e78d5b0e8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:48.544112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0822515d-b5fe-4a0f-9499-1c9e78d5b0e8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:48.672084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0822515d-b5fe-4a0f-9499-1c9e78d5b0e8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:48.679814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0822515d-b5fe-4a0f-9499-1c9e78d5b0e8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148601 Nov 08 17:58:48.680374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1160/2317] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:48 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:49.500015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:49.500606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:49.507058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:49.507509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:49.508276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:49.508712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:49.567735 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:49.575988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:49.577481 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:49.578622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-26c589fe-0838-477d-ba35-bfd0eb697090 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082290 Nov 08 17:58:49.579181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1158/2318] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:49.699813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-60ca790f-5558-44ff-8f93-816ed186756d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:49.700610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-60ca790f-5558-44ff-8f93-816ed186756d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:49.707001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60ca790f-5558-44ff-8f93-816ed186756d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:49.707447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60ca790f-5558-44ff-8f93-816ed186756d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:49.708224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60ca790f-5558-44ff-8f93-816ed186756d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:49.708683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-60ca790f-5558-44ff-8f93-816ed186756d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:49.840273 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-60ca790f-5558-44ff-8f93-816ed186756d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:49.848080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-60ca790f-5558-44ff-8f93-816ed186756d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.155698 Nov 08 17:58:49.848646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1161/2319] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:49 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:50.494199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:58:50.494375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:58:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:58:50.596089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:50.596700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:50.603168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:50.603610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:50.604372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:50.604797 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:50.666282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:50.674384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:50.675942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:50.677068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1845e19d-9f5a-46f6-9d2c-121c3250be9e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084552 Nov 08 17:58:50.677623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1159/2320] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:50.864852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c96b3f11-8bc5-400d-8aee-cb50a398083d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:50.865462 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c96b3f11-8bc5-400d-8aee-cb50a398083d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:50.872274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c96b3f11-8bc5-400d-8aee-cb50a398083d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:50.872714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c96b3f11-8bc5-400d-8aee-cb50a398083d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:50.873483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c96b3f11-8bc5-400d-8aee-cb50a398083d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:50.873918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c96b3f11-8bc5-400d-8aee-cb50a398083d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:51.009073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c96b3f11-8bc5-400d-8aee-cb50a398083d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:51.010318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c96b3f11-8bc5-400d-8aee-cb50a398083d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149083 Nov 08 17:58:51.010923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1162/2321] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:50 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:51.696159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:51.696760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:51.702922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:51.703364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:51.704130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:51.704555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:51.762766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:51.770771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:51.772259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:51.773976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b723c524-90d4-45f1-8548-0cc4d500156e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082334 Nov 08 17:58:51.774542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1160/2322] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:52.027613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2fa6781e-564f-48b1-9957-586b88f3e8ea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:52.028229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2fa6781e-564f-48b1-9957-586b88f3e8ea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:52.034431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fa6781e-564f-48b1-9957-586b88f3e8ea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:52.034898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fa6781e-564f-48b1-9957-586b88f3e8ea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:52.035652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fa6781e-564f-48b1-9957-586b88f3e8ea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:52.036077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fa6781e-564f-48b1-9957-586b88f3e8ea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:52.174224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2fa6781e-564f-48b1-9957-586b88f3e8ea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:52.181800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2fa6781e-564f-48b1-9957-586b88f3e8ea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.157876 Nov 08 17:58:52.182353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1163/2323] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:52 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:58:52.791647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:52.792261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:52.798416 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:52.798893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:52.799658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:52.800085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:52.858222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:52.867094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:52.868572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:52.869677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-af9e2a4c-ce5e-4340-80d4-602f0df2f7bc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081863 Nov 08 17:58:52.870227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1161/2324] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:53.198183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-46ff96c9-1110-4675-852b-c89cb3a98561 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:53.198816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-46ff96c9-1110-4675-852b-c89cb3a98561 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:53.205058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46ff96c9-1110-4675-852b-c89cb3a98561 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:53.205502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46ff96c9-1110-4675-852b-c89cb3a98561 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:53.206267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46ff96c9-1110-4675-852b-c89cb3a98561 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:53.206795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46ff96c9-1110-4675-852b-c89cb3a98561 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:53.333302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-46ff96c9-1110-4675-852b-c89cb3a98561 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:53.340941 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-46ff96c9-1110-4675-852b-c89cb3a98561 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146430 Nov 08 17:58:53.341495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1164/2325] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:53 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:53.987735 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:53.988967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:53.995461 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:53.995985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:53.996900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:53.997403 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:54.057558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:54.065702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:54.067217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:54.068341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1a022d09-0819-4486-91c7-a97ebdd24cf2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.185143 Nov 08 17:58:54.068895 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1162/2326] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:54.357676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-93f79f1e-5d3e-45e0-8835-b7029b8444a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:54.358224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-93f79f1e-5d3e-45e0-8835-b7029b8444a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:54.364466 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93f79f1e-5d3e-45e0-8835-b7029b8444a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:54.364900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93f79f1e-5d3e-45e0-8835-b7029b8444a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:54.365656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93f79f1e-5d3e-45e0-8835-b7029b8444a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:54.366079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-93f79f1e-5d3e-45e0-8835-b7029b8444a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:54.493969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-93f79f1e-5d3e-45e0-8835-b7029b8444a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:54.501645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-93f79f1e-5d3e-45e0-8835-b7029b8444a8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147669 Nov 08 17:58:54.502211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1165/2327] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:54 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:55.086167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:55.086789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:55.093017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:55.093455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:55.094213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:55.094702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:55.152618 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:55.160607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:55.162137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:55.163521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b4da2546-44f9-4954-878b-0b21f19e4eb6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080988 Nov 08 17:58:55.164069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1163/2328] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:55.518618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-14b04afb-9b29-4348-8230-01b452de0835 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:55.519219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-14b04afb-9b29-4348-8230-01b452de0835 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:55.525562 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14b04afb-9b29-4348-8230-01b452de0835 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:55.526001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14b04afb-9b29-4348-8230-01b452de0835 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:55.526790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14b04afb-9b29-4348-8230-01b452de0835 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:55.527215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-14b04afb-9b29-4348-8230-01b452de0835 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:55.663560 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-14b04afb-9b29-4348-8230-01b452de0835 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:55.664489 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-14b04afb-9b29-4348-8230-01b452de0835 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149478 Nov 08 17:58:55.665041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1166/2329] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:55 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:56.181169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:56.181873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:56.188120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:56.188598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:56.189359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:56.189787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:56.253022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:56.261904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:56.263423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:56.264541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-de4b43cb-28e0-4130-a710-be331486a2c5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087232 Nov 08 17:58:56.265093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1164/2330] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:56.681652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6fd4eebc-2773-46c9-b789-2f17a7807c59 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:56.682243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6fd4eebc-2773-46c9-b789-2f17a7807c59 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:56.688481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6fd4eebc-2773-46c9-b789-2f17a7807c59 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:56.688922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6fd4eebc-2773-46c9-b789-2f17a7807c59 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:56.689686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6fd4eebc-2773-46c9-b789-2f17a7807c59 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:56.690115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6fd4eebc-2773-46c9-b789-2f17a7807c59 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:56.815931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6fd4eebc-2773-46c9-b789-2f17a7807c59 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:56.824331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6fd4eebc-2773-46c9-b789-2f17a7807c59 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146853 Nov 08 17:58:56.824894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1167/2331] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:56 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:57.283053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:57.283590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:57.290420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:57.290894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:57.291661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:57.292093 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:57.350981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:57.359557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:57.361123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:57.362251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4526249a-7192-45c0-8f07-66497b4d182d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083050 Nov 08 17:58:57.362836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1165/2332] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:57.841654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-47356453-8561-43a7-b741-984fa42dd2c7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:57.842274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-47356453-8561-43a7-b741-984fa42dd2c7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:57.848637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47356453-8561-43a7-b741-984fa42dd2c7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:57.849077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47356453-8561-43a7-b741-984fa42dd2c7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:57.849848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47356453-8561-43a7-b741-984fa42dd2c7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:57.850337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-47356453-8561-43a7-b741-984fa42dd2c7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:57.977972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-47356453-8561-43a7-b741-984fa42dd2c7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:57.985582 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-47356453-8561-43a7-b741-984fa42dd2c7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147776 Nov 08 17:58:57.986153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1168/2333] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:57 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:58.379761 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:58.380352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:58.387242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:58.387677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:58.388460 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:58.388886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:58.446062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:58.454029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:58.455540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:58.456677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4427620a-89e1-4a79-89c8-3754288d8e89 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080613 Nov 08 17:58:58.457222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1166/2334] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:58:59.002638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3eb96cc6-9bc1-4e72-a3ab-6250cc305cfe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:59.003374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3eb96cc6-9bc1-4e72-a3ab-6250cc305cfe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:59.010025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3eb96cc6-9bc1-4e72-a3ab-6250cc305cfe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:59.010483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3eb96cc6-9bc1-4e72-a3ab-6250cc305cfe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:59.011335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3eb96cc6-9bc1-4e72-a3ab-6250cc305cfe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:59.011763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3eb96cc6-9bc1-4e72-a3ab-6250cc305cfe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:59.138627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3eb96cc6-9bc1-4e72-a3ab-6250cc305cfe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:59.146208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3eb96cc6-9bc1-4e72-a3ab-6250cc305cfe tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147212 Nov 08 17:58:59.146807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1169/2335] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:58:58 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:58:59.474575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:58:59.475185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:58:59.481711 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:59.482155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:59.482946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:58:59.483380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:58:59.541584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:59.549824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:59.551347 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:58:59.552499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-33921ad9-a8e8-44d6-9d40-7355a32383a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081652 Nov 08 17:58:59.553050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1167/2336] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:58:59 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:00.164566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c0cfb176-b422-4c00-b337-5eca92a970ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:00.165168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c0cfb176-b422-4c00-b337-5eca92a970ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:00.171355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0cfb176-b422-4c00-b337-5eca92a970ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:00.171808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0cfb176-b422-4c00-b337-5eca92a970ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:00.172577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0cfb176-b422-4c00-b337-5eca92a970ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:00.173010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0cfb176-b422-4c00-b337-5eca92a970ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:00.303827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c0cfb176-b422-4c00-b337-5eca92a970ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:00.311556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c0cfb176-b422-4c00-b337-5eca92a970ab tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150929 Nov 08 17:59:00.312118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1170/2337] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:00 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:00.571652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:00.572203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:00.578489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:00.578929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:00.579690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:00.580119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:00.637838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:00.645883 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:00.647561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:00.648669 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-481afa44-6262-43b4-a396-4a8a3e4444a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081533 Nov 08 17:59:00.649421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1168/2338] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:01.328938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-95658765-e768-41a0-96e3-c258387a0b64 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:01.329501 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-95658765-e768-41a0-96e3-c258387a0b64 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:01.336193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95658765-e768-41a0-96e3-c258387a0b64 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:01.336628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95658765-e768-41a0-96e3-c258387a0b64 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:01.337392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95658765-e768-41a0-96e3-c258387a0b64 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:01.337823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95658765-e768-41a0-96e3-c258387a0b64 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:01.466672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95658765-e768-41a0-96e3-c258387a0b64 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:01.474344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-95658765-e768-41a0-96e3-c258387a0b64 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149140 Nov 08 17:59:01.474929 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1171/2339] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:01 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:01.667218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:01.667842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:01.673998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:01.674434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:01.675220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:01.675647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:01.737031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:01.746032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:01.747558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:01.748681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-df35d8af-2f00-49e6-8cf7-6155f0fdd99c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085112 Nov 08 17:59:01.749235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1169/2340] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:02.490346 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-22ad2989-3ae1-48dd-a1fa-b4e114f463e0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:02.490991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-22ad2989-3ae1-48dd-a1fa-b4e114f463e0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:02.497717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22ad2989-3ae1-48dd-a1fa-b4e114f463e0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:02.498189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22ad2989-3ae1-48dd-a1fa-b4e114f463e0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:02.498999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22ad2989-3ae1-48dd-a1fa-b4e114f463e0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:02.499430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-22ad2989-3ae1-48dd-a1fa-b4e114f463e0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:02.625809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-22ad2989-3ae1-48dd-a1fa-b4e114f463e0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:02.634283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-22ad2989-3ae1-48dd-a1fa-b4e114f463e0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147609 Nov 08 17:59:02.634874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1172/2341] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:02 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:02.766690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:02.767234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:02.773537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:02.773980 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:02.774786 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:02.775224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:02.833273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:02.841619 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:02.843182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:02.854232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ad9536e2-c1c2-421c-a548-a33d89576aec tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081467 Nov 08 17:59:02.854232 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1170/2342] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:03.651731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4974c880-e74a-445b-867c-dd67a2cae860 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:03.652475 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4974c880-e74a-445b-867c-dd67a2cae860 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:03.658725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4974c880-e74a-445b-867c-dd67a2cae860 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:03.659163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4974c880-e74a-445b-867c-dd67a2cae860 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:03.659927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4974c880-e74a-445b-867c-dd67a2cae860 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:03.660353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4974c880-e74a-445b-867c-dd67a2cae860 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:03.789720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4974c880-e74a-445b-867c-dd67a2cae860 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:03.797381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4974c880-e74a-445b-867c-dd67a2cae860 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150095 Nov 08 17:59:03.797942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1173/2343] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:03 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:03.870334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:03.870994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:03.877520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:03.877962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:03.878759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:03.879191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:03.937370 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:03.945985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:03.947506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:03.948627 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-eb358eb8-0a58-4914-94a2-400a0af26173 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082000 Nov 08 17:59:03.949182 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1171/2344] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:04.814058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-933783f7-5bb9-47d3-91a7-cb27dd66c57f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:04.814730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-933783f7-5bb9-47d3-91a7-cb27dd66c57f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:04.821439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-933783f7-5bb9-47d3-91a7-cb27dd66c57f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:04.821887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-933783f7-5bb9-47d3-91a7-cb27dd66c57f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:04.822762 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-933783f7-5bb9-47d3-91a7-cb27dd66c57f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:04.823247 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-933783f7-5bb9-47d3-91a7-cb27dd66c57f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:04.954424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-933783f7-5bb9-47d3-91a7-cb27dd66c57f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:04.962764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-933783f7-5bb9-47d3-91a7-cb27dd66c57f tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152297 Nov 08 17:59:04.963572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1174/2345] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:04 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:04.972739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:04.973341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:04.980296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:04.980735 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:04.981500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:04.982105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:05.042548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:05.050668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:05.052175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:05.053320 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a818ca74-15ee-4357-a2bf-6d7281400f51 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.089619 Nov 08 17:59:05.053871 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1172/2346] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:05.980074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b4460725-295b-4c44-b604-6439e16154cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:05.980708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b4460725-295b-4c44-b604-6439e16154cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:05.986974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4460725-295b-4c44-b604-6439e16154cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:05.987413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4460725-295b-4c44-b604-6439e16154cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:05.988178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4460725-295b-4c44-b604-6439e16154cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:05.988729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4460725-295b-4c44-b604-6439e16154cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:06.071291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:06.071890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:06.078057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:06.078542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:06.079316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:06.079743 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:06.132541 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b4460725-295b-4c44-b604-6439e16154cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:06.143152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b4460725-295b-4c44-b604-6439e16154cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.167379 Nov 08 17:59:06.143739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1175/2347] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:05 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:06.146700 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:06.155083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:06.156563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:06.157679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7b6cd88f-9786-40fb-98f6-2ed7f1b14da1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.090139 Nov 08 17:59:06.158225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1173/2348] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:07.159473 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9c6dffa2-7804-4432-b0ab-d61a72ba5e0c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:07.160107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9c6dffa2-7804-4432-b0ab-d61a72ba5e0c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:07.166739 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c6dffa2-7804-4432-b0ab-d61a72ba5e0c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:07.167187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c6dffa2-7804-4432-b0ab-d61a72ba5e0c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:07.167962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c6dffa2-7804-4432-b0ab-d61a72ba5e0c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:07.168396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9c6dffa2-7804-4432-b0ab-d61a72ba5e0c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:07.175331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:07.175941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:07.183156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:07.183540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:07.184312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:07.184745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:07.254658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:07.263517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:07.264994 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:07.266152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-038eacb1-68e7-4058-af85-b802ce0285a7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.094520 Nov 08 17:59:07.266733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1174/2349] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:07.322650 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9c6dffa2-7804-4432-b0ab-d61a72ba5e0c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:07.330251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9c6dffa2-7804-4432-b0ab-d61a72ba5e0c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.174427 Nov 08 17:59:07.330856 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1176/2350] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:07 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:59:08.284949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:08.285537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:08.291777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:08.292229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:08.292990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:08.293418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:08.347380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f0539def-a617-4eb2-b9db-b793342fefb6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:08.348017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f0539def-a617-4eb2-b9db-b793342fefb6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:08.353975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:08.354575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0539def-a617-4eb2-b9db-b793342fefb6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:08.355021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0539def-a617-4eb2-b9db-b793342fefb6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:08.355799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0539def-a617-4eb2-b9db-b793342fefb6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:08.356228 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f0539def-a617-4eb2-b9db-b793342fefb6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:08.362372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:08.363906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:08.365033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-754127c5-0741-4635-81b2-bc04d679a5d2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083866 Nov 08 17:59:08.365596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1175/2351] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:08.481904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f0539def-a617-4eb2-b9db-b793342fefb6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:08.489628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f0539def-a617-4eb2-b9db-b793342fefb6 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146397 Nov 08 17:59:08.490204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1177/2352] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:08 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:59:09.382963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:09.383568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:09.389751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:09.390190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:09.390975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:09.391401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:09.449042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:09.457171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:09.458702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:09.459822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-858a33e2-19aa-42a3-a1a8-a0690782f15c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080641 Nov 08 17:59:09.460875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1176/2353] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:09 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:09.506528 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7bb01428-7abc-4540-85ed-0895689f528c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:09.507161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7bb01428-7abc-4540-85ed-0895689f528c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:09.513375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7bb01428-7abc-4540-85ed-0895689f528c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:09.513819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7bb01428-7abc-4540-85ed-0895689f528c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:09.514613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7bb01428-7abc-4540-85ed-0895689f528c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:09.515094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7bb01428-7abc-4540-85ed-0895689f528c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:09.644501 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7bb01428-7abc-4540-85ed-0895689f528c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:09.653109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7bb01428-7abc-4540-85ed-0895689f528c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150115 Nov 08 17:59:09.653680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1178/2354] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:09 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:10.478015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:10.478649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:10.485330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:10.485753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:10.486414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:10.486877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:10.547197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:10.556168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:10.557729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:10.558885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-895fe56e-f80a-423f-885a-699bb4452f98 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085367 Nov 08 17:59:10.559610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1177/2355] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:10.670074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9826b23f-1c68-47d2-9bd7-b9d32170f9b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:10.670714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9826b23f-1c68-47d2-9bd7-b9d32170f9b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:10.677502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9826b23f-1c68-47d2-9bd7-b9d32170f9b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:10.677946 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9826b23f-1c68-47d2-9bd7-b9d32170f9b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:10.678786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9826b23f-1c68-47d2-9bd7-b9d32170f9b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:10.679867 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9826b23f-1c68-47d2-9bd7-b9d32170f9b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:10.810748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9826b23f-1c68-47d2-9bd7-b9d32170f9b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:10.818398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9826b23f-1c68-47d2-9bd7-b9d32170f9b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151928 Nov 08 17:59:10.818983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1179/2356] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:10 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:11.575694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:11.576301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:11.582578 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:11.583034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:11.583809 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:11.584245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:11.642286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:11.650887 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:11.652392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:11.653552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4eee9a71-f2a9-46a9-9c21-4139f26c5849 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081586 Nov 08 17:59:11.654109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1178/2357] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:11.835738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-71ebfebd-c8dd-4070-9f0d-f49ee3fe2f76 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:11.836300 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-71ebfebd-c8dd-4070-9f0d-f49ee3fe2f76 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:11.842516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71ebfebd-c8dd-4070-9f0d-f49ee3fe2f76 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:11.842962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71ebfebd-c8dd-4070-9f0d-f49ee3fe2f76 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:11.843718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71ebfebd-c8dd-4070-9f0d-f49ee3fe2f76 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:11.844171 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71ebfebd-c8dd-4070-9f0d-f49ee3fe2f76 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:11.976513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-71ebfebd-c8dd-4070-9f0d-f49ee3fe2f76 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:11.984140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-71ebfebd-c8dd-4070-9f0d-f49ee3fe2f76 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152629 Nov 08 17:59:11.984706 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1180/2358] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:11 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:12.672164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:12.672768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:12.680431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:12.680894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:12.681691 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:12.682130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:12.746365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:12.754484 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:12.755964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:12.757079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a31f5e1a-c470-45cc-a5c7-ae936ac3b143 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.088627 Nov 08 17:59:12.757626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1179/2359] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:13.000877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-da2c0413-a043-43df-9a28-2917c0280756 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:13.006375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-da2c0413-a043-43df-9a28-2917c0280756 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:13.007912 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-da2c0413-a043-43df-9a28-2917c0280756 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:13.008358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-da2c0413-a043-43df-9a28-2917c0280756 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:13.009131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-da2c0413-a043-43df-9a28-2917c0280756 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:13.009572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-da2c0413-a043-43df-9a28-2917c0280756 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:13.138251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-da2c0413-a043-43df-9a28-2917c0280756 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:13.146054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-da2c0413-a043-43df-9a28-2917c0280756 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148815 Nov 08 17:59:13.146643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1181/2360] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:12 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:13.775582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:13.776180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:13.782114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:13.782602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:13.783374 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:13.783802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:13.845185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:13.853610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:13.855129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:13.856245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0a12975c-fc5b-47b1-bc83-48d05a58c59b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085063 Nov 08 17:59:13.856803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1180/2361] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:14.164044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cb8527c7-c337-4277-9d67-1b0897557ade tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:14.164707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cb8527c7-c337-4277-9d67-1b0897557ade tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:14.170561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb8527c7-c337-4277-9d67-1b0897557ade tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:14.171003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb8527c7-c337-4277-9d67-1b0897557ade tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:14.171771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb8527c7-c337-4277-9d67-1b0897557ade tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:14.172199 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cb8527c7-c337-4277-9d67-1b0897557ade tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:14.307920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cb8527c7-c337-4277-9d67-1b0897557ade tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:14.315713 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cb8527c7-c337-4277-9d67-1b0897557ade tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.156061 Nov 08 17:59:14.316277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1182/2362] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:14 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:14.875193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:14.875802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:14.882621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:14.883064 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:14.883840 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:14.884494 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:14.943497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:14.952334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:14.953821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:14.954980 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e3f6d57f-fb38-459b-83ea-18a291c4a0b1 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083582 Nov 08 17:59:14.955524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1181/2363] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:15.333303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7ccc05fa-b3df-446a-b9d3-7d5731b351cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:15.333891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7ccc05fa-b3df-446a-b9d3-7d5731b351cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:15.340415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ccc05fa-b3df-446a-b9d3-7d5731b351cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:15.340860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ccc05fa-b3df-446a-b9d3-7d5731b351cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:15.341633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ccc05fa-b3df-446a-b9d3-7d5731b351cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:15.342088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7ccc05fa-b3df-446a-b9d3-7d5731b351cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:15.470781 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7ccc05fa-b3df-446a-b9d3-7d5731b351cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:15.478795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7ccc05fa-b3df-446a-b9d3-7d5731b351cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149195 Nov 08 17:59:15.479358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1183/2364] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:15 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:15.973090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:15.973680 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:15.980617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:15.981055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:15.981826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:15.982234 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:16.041620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:16.049575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:16.051083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:16.052196 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5e6cbb8d-b838-4d11-bd6a-b3a20c012101 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082848 Nov 08 17:59:16.052749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1182/2365] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:16.383094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:59:16.383633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 17:59:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:59:16.495387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8788635d-12fe-4dd3-a164-bff205ac15e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:16.495988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8788635d-12fe-4dd3-a164-bff205ac15e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:16.502241 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8788635d-12fe-4dd3-a164-bff205ac15e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:16.502715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8788635d-12fe-4dd3-a164-bff205ac15e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:16.503484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8788635d-12fe-4dd3-a164-bff205ac15e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:16.503918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8788635d-12fe-4dd3-a164-bff205ac15e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:16.630303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8788635d-12fe-4dd3-a164-bff205ac15e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:16.638332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8788635d-12fe-4dd3-a164-bff205ac15e1 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146595 Nov 08 17:59:16.638863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1184/2366] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:16 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:17.070638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:17.071305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:17.077504 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:17.077948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:17.078820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:17.079254 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:17.139304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:17.148371 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:17.149718 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:17.152455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3022d606-7efa-4288-8504-929214c9b561 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084250 Nov 08 17:59:17.152455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1183/2367] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:17.655221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0460ece0-9d5d-4ebc-a40d-9ff9c6f9c379 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:17.655810 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0460ece0-9d5d-4ebc-a40d-9ff9c6f9c379 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:17.662314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0460ece0-9d5d-4ebc-a40d-9ff9c6f9c379 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:17.662796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0460ece0-9d5d-4ebc-a40d-9ff9c6f9c379 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:17.663870 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0460ece0-9d5d-4ebc-a40d-9ff9c6f9c379 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:17.664387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0460ece0-9d5d-4ebc-a40d-9ff9c6f9c379 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:17.796718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0460ece0-9d5d-4ebc-a40d-9ff9c6f9c379 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:17.805243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0460ece0-9d5d-4ebc-a40d-9ff9c6f9c379 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153556 Nov 08 17:59:17.805800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1185/2368] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:17 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:18.169667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:18.170207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:18.176506 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:18.176955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:18.177784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:18.178263 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:18.237327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:18.246322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:18.247842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:18.248969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fccfc578-1429-4e9c-86ce-7ea3d19d7b99 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083236 Nov 08 17:59:18.249524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1184/2369] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:18.868183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5307337b-a903-4e02-98ce-0708588ff0ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:18.868771 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5307337b-a903-4e02-98ce-0708588ff0ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:18.874976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5307337b-a903-4e02-98ce-0708588ff0ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:18.875415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5307337b-a903-4e02-98ce-0708588ff0ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:18.876181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5307337b-a903-4e02-98ce-0708588ff0ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:18.876610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5307337b-a903-4e02-98ce-0708588ff0ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:19.004702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5307337b-a903-4e02-98ce-0708588ff0ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:19.013033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5307337b-a903-4e02-98ce-0708588ff0ae tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148621 Nov 08 17:59:19.013580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1186/2370] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:18 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:19.266605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:19.267174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:19.273575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:19.274021 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:19.274901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:19.275328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:19.338954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:19.347366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:19.348995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:19.350166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d32339b8-3cfb-4bad-90e9-2e1c739717ab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087398 Nov 08 17:59:19.351966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1185/2371] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:20.030796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f5caf9c9-291d-442c-afb7-34862414f232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:20.031440 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f5caf9c9-291d-442c-afb7-34862414f232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:20.038267 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f5caf9c9-291d-442c-afb7-34862414f232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:20.038744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f5caf9c9-291d-442c-afb7-34862414f232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:20.039648 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f5caf9c9-291d-442c-afb7-34862414f232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:20.040071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f5caf9c9-291d-442c-afb7-34862414f232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:20.168334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f5caf9c9-291d-442c-afb7-34862414f232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:20.176019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f5caf9c9-291d-442c-afb7-34862414f232 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149306 Nov 08 17:59:20.176609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1187/2372] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:20 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:20.369829 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:20.370387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:20.376580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:20.377020 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:20.377802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:20.378229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:20.437570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:20.447340 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:20.448823 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:20.449943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f8ccf278-987e-4d68-8048-0b6f6becd0ef tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084415 Nov 08 17:59:20.450520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1186/2373] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:20 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:21.192911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2c3733b6-15ee-483b-a321-d011404d7fdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:21.193444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2c3733b6-15ee-483b-a321-d011404d7fdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:21.199741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2c3733b6-15ee-483b-a321-d011404d7fdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:21.200176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2c3733b6-15ee-483b-a321-d011404d7fdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:21.200935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2c3733b6-15ee-483b-a321-d011404d7fdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:21.201364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2c3733b6-15ee-483b-a321-d011404d7fdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:21.329656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2c3733b6-15ee-483b-a321-d011404d7fdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:21.338127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2c3733b6-15ee-483b-a321-d011404d7fdc tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148957 Nov 08 17:59:21.338730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1188/2374] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:21 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:21.468389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:21.468954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:21.475261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:21.475712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:21.476745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:21.477180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:21.535603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:21.543833 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:21.545327 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:21.546477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e08674ac-3f73-4913-bf6e-62221bf62221 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081936 Nov 08 17:59:21.553298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1187/2375] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:22.355641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-808e2910-1dba-42c4-95fb-ea9187133808 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:22.356183 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-808e2910-1dba-42c4-95fb-ea9187133808 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:22.362791 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-808e2910-1dba-42c4-95fb-ea9187133808 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:22.363233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-808e2910-1dba-42c4-95fb-ea9187133808 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:22.364000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-808e2910-1dba-42c4-95fb-ea9187133808 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:22.364423 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-808e2910-1dba-42c4-95fb-ea9187133808 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:22.494575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-808e2910-1dba-42c4-95fb-ea9187133808 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:22.502354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-808e2910-1dba-42c4-95fb-ea9187133808 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151227 Nov 08 17:59:22.508557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1189/2376] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:22 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:22.564311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:22.564938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:22.571285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:22.571732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:22.572503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:22.572934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:22.630174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:22.638244 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:22.639784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:22.640908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-33497b6a-96d7-4dd7-9f4a-4a97ae0e3142 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080268 Nov 08 17:59:22.641458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1188/2377] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:23.519377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-90ba5170-a19a-4f73-85be-dc096ad7b9cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:23.519979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-90ba5170-a19a-4f73-85be-dc096ad7b9cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:23.526420 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90ba5170-a19a-4f73-85be-dc096ad7b9cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:23.526887 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90ba5170-a19a-4f73-85be-dc096ad7b9cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:23.527646 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90ba5170-a19a-4f73-85be-dc096ad7b9cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:23.528071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-90ba5170-a19a-4f73-85be-dc096ad7b9cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:23.657324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-90ba5170-a19a-4f73-85be-dc096ad7b9cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:23.658326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:23.659008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:23.665817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:23.665999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-90ba5170-a19a-4f73-85be-dc096ad7b9cf tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150218 Nov 08 17:59:23.666255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:23.666559 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1190/2378] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:23 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:23.667131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:23.667632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:23.725086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:23.734201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:23.735748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:23.736962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-efe06acc-9391-4307-9564-bf6f882dbe95 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082207 Nov 08 17:59:23.737517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1189/2379] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:24.683039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2fb03a64-7b01-44d1-950b-a588cdadb421 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:24.683648 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2fb03a64-7b01-44d1-950b-a588cdadb421 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:24.689802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fb03a64-7b01-44d1-950b-a588cdadb421 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:24.690243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fb03a64-7b01-44d1-950b-a588cdadb421 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:24.691031 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fb03a64-7b01-44d1-950b-a588cdadb421 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:24.691463 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fb03a64-7b01-44d1-950b-a588cdadb421 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:24.755617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:24.756223 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:24.763798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:24.764251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:24.765033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:24.765470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:24.840865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:24.845484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2fb03a64-7b01-44d1-950b-a588cdadb421 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:24.849307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:24.850835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:24.852976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ea6607a9-a40e-4be5-b8b5-6f824c8f7479 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.100364 Nov 08 17:59:24.853553 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1190/2380] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:24.853675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2fb03a64-7b01-44d1-950b-a588cdadb421 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.174834 Nov 08 17:59:24.854211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1191/2381] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:24 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:25.871102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:25.871796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c490cab5-4292-4ab7-a04a-19931968a7d4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:25.872168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:25.872281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c490cab5-4292-4ab7-a04a-19931968a7d4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:25.877959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:25.878154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c490cab5-4292-4ab7-a04a-19931968a7d4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:25.878400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:25.878557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c490cab5-4292-4ab7-a04a-19931968a7d4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:25.879207 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:25.879348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c490cab5-4292-4ab7-a04a-19931968a7d4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:25.879636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:25.879745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c490cab5-4292-4ab7-a04a-19931968a7d4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:25.955801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:25.964044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:25.965530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:25.966682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-13b8d9d9-bdf8-4992-83da-6340b3df4b78 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.099876 Nov 08 17:59:25.967239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1192/2382] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:25.976010 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:59:25.976529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:59:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe (ip 10.222.0.18) !!! Nov 08 17:59:26.036198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c490cab5-4292-4ab7-a04a-19931968a7d4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:26.045537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c490cab5-4292-4ab7-a04a-19931968a7d4 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.178737 Nov 08 17:59:26.046133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1191/2383] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:25 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:26.985329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:26.985952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:26.992450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:26.993403 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:26.994432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:26.994891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:27.054529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:27.064109 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:27.064318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ebeeac89-c985-49e0-812e-70becbb81106 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:27.064927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ebeeac89-c985-49e0-812e-70becbb81106 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:27.065602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:27.066978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-39defab0-893d-49ab-9dcf-41492ccd9289 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085301 Nov 08 17:59:27.067659 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1193/2384] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:27.071638 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebeeac89-c985-49e0-812e-70becbb81106 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:27.072947 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebeeac89-c985-49e0-812e-70becbb81106 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:27.073951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebeeac89-c985-49e0-812e-70becbb81106 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:27.074426 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ebeeac89-c985-49e0-812e-70becbb81106 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:27.207072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ebeeac89-c985-49e0-812e-70becbb81106 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:27.214757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ebeeac89-c985-49e0-812e-70becbb81106 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154119 Nov 08 17:59:27.215318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1192/2385] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:27 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:59:28.086113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:28.086741 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:28.093699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:28.094139 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:28.094934 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:28.095361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:28.154419 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:28.162382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:28.163897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:28.165007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a65f5eda-73ad-46d6-81b6-61f694589c0d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082590 Nov 08 17:59:28.165556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1194/2386] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:28.232185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-888ca8da-688b-420b-80a9-e9dda4303064 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:28.232767 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-888ca8da-688b-420b-80a9-e9dda4303064 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:28.239108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888ca8da-688b-420b-80a9-e9dda4303064 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:28.239548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888ca8da-688b-420b-80a9-e9dda4303064 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:28.240308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888ca8da-688b-420b-80a9-e9dda4303064 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:28.240760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-888ca8da-688b-420b-80a9-e9dda4303064 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:28.369493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-888ca8da-688b-420b-80a9-e9dda4303064 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:28.377207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-888ca8da-688b-420b-80a9-e9dda4303064 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148861 Nov 08 17:59:28.377784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1193/2387] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:28 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:29.183211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:29.184445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:29.190680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:29.191125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:29.191945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:29.192311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:29.256743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:29.265343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:29.266860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:29.267995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-07e07e0d-ca35-4e5b-96aa-89a066a13bbc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.088696 Nov 08 17:59:29.268755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1195/2388] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:29.394770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-02c17000-2243-4c40-96d2-1bf7b6620141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:29.395372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-02c17000-2243-4c40-96d2-1bf7b6620141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:29.402271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02c17000-2243-4c40-96d2-1bf7b6620141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:29.402738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02c17000-2243-4c40-96d2-1bf7b6620141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:29.403502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02c17000-2243-4c40-96d2-1bf7b6620141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:29.403928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-02c17000-2243-4c40-96d2-1bf7b6620141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:29.533566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-02c17000-2243-4c40-96d2-1bf7b6620141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:29.541773 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-02c17000-2243-4c40-96d2-1bf7b6620141 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.150690 Nov 08 17:59:29.542368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1194/2389] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:29 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:30.286760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:30.287397 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:30.294554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:30.295022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:30.295930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:30.296426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:30.355367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:30.363477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:30.368816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:30.368816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c7fa499f-abd4-40bf-8781-29bc362576dc tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083424 Nov 08 17:59:30.368816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1196/2390] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:30.557910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-63aa6109-5cea-4cb6-95a7-790e18591250 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:30.558443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-63aa6109-5cea-4cb6-95a7-790e18591250 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:30.564965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-63aa6109-5cea-4cb6-95a7-790e18591250 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:30.565406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-63aa6109-5cea-4cb6-95a7-790e18591250 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:30.566167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-63aa6109-5cea-4cb6-95a7-790e18591250 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:30.566676 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-63aa6109-5cea-4cb6-95a7-790e18591250 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:30.699284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-63aa6109-5cea-4cb6-95a7-790e18591250 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:30.707049 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-63aa6109-5cea-4cb6-95a7-790e18591250 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153205 Nov 08 17:59:30.707605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1195/2391] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:30 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:31.384736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:31.385364 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:31.391745 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:31.392182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:31.393020 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:31.393515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:31.452130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:31.460678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:31.462164 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:31.463917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2cc9a483-bef3-404c-ae6f-6c0dd4c27548 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083230 Nov 08 17:59:31.464486 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1197/2392] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:31 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:31.723752 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5eef16c5-f7e9-40a8-b009-0db90fe34613 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:31.724289 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5eef16c5-f7e9-40a8-b009-0db90fe34613 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:31.731511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5eef16c5-f7e9-40a8-b009-0db90fe34613 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:31.731992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5eef16c5-f7e9-40a8-b009-0db90fe34613 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:31.732782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5eef16c5-f7e9-40a8-b009-0db90fe34613 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:31.733211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5eef16c5-f7e9-40a8-b009-0db90fe34613 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:31.860343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5eef16c5-f7e9-40a8-b009-0db90fe34613 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:31.868048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5eef16c5-f7e9-40a8-b009-0db90fe34613 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147990 Nov 08 17:59:31.868945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1196/2393] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:31 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:32.482668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:32.483277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:32.489594 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:32.490035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:32.490861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:32.491295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:32.550508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:32.559354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:32.560845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:32.561972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-81d36371-92d3-4dc1-bcf2-bfa1709b3220 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083697 Nov 08 17:59:32.562546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1198/2394] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:32.884759 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1ea953eb-46a3-4165-97b0-426e069232b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:32.885512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1ea953eb-46a3-4165-97b0-426e069232b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:32.891740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ea953eb-46a3-4165-97b0-426e069232b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:32.892191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ea953eb-46a3-4165-97b0-426e069232b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:32.892954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ea953eb-46a3-4165-97b0-426e069232b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:32.893385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1ea953eb-46a3-4165-97b0-426e069232b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:33.278571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1ea953eb-46a3-4165-97b0-426e069232b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:33.286236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1ea953eb-46a3-4165-97b0-426e069232b3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.405111 Nov 08 17:59:33.286836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1197/2395] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:32 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:59:33.580733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:33.581278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:33.587554 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:33.587998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:33.589571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:33.590011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:33.647577 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:33.656302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:33.657795 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:33.658961 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2e0522dc-d132-417b-bc6b-3631707aa66f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082013 Nov 08 17:59:33.659514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1199/2396] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:34.303611 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a24509e8-b804-49af-ba16-97bf6d6965b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:34.304159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a24509e8-b804-49af-ba16-97bf6d6965b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:34.310620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a24509e8-b804-49af-ba16-97bf6d6965b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:34.311065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a24509e8-b804-49af-ba16-97bf6d6965b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:34.311846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a24509e8-b804-49af-ba16-97bf6d6965b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:34.312273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a24509e8-b804-49af-ba16-97bf6d6965b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:34.440008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a24509e8-b804-49af-ba16-97bf6d6965b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:34.448222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a24509e8-b804-49af-ba16-97bf6d6965b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148313 Nov 08 17:59:34.448783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1198/2397] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:34 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:34.676922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:34.677529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:34.684356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:34.684799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:34.685566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:34.686144 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:34.747314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:34.755680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:34.757206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:34.758332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d01b23fc-96b8-44c8-9baa-c63f4eaba45c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085146 Nov 08 17:59:34.758920 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1200/2398] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:35.465584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7d19a550-fa87-4d3b-b4d0-a1fc2eadb108 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:35.466190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7d19a550-fa87-4d3b-b4d0-a1fc2eadb108 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:35.472403 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d19a550-fa87-4d3b-b4d0-a1fc2eadb108 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:35.472847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d19a550-fa87-4d3b-b4d0-a1fc2eadb108 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:35.473615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d19a550-fa87-4d3b-b4d0-a1fc2eadb108 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:35.474045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d19a550-fa87-4d3b-b4d0-a1fc2eadb108 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:35.599259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7d19a550-fa87-4d3b-b4d0-a1fc2eadb108 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:35.607097 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7d19a550-fa87-4d3b-b4d0-a1fc2eadb108 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145683 Nov 08 17:59:35.607664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1199/2399] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:35 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:35.776981 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:35.777673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:35.783759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:35.784204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:35.784998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:35.785413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:35.842885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:35.851261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:35.852775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:35.853949 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-95819e43-d97d-4f09-bd7a-760d3053ffb4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081351 Nov 08 17:59:35.854743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1201/2400] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:36.623271 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a7adab44-3a86-46e0-a568-b8559f1c3983 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:36.623872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a7adab44-3a86-46e0-a568-b8559f1c3983 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:36.629998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7adab44-3a86-46e0-a568-b8559f1c3983 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:36.630435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7adab44-3a86-46e0-a568-b8559f1c3983 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:36.631224 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7adab44-3a86-46e0-a568-b8559f1c3983 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:36.631649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a7adab44-3a86-46e0-a568-b8559f1c3983 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:36.759955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a7adab44-3a86-46e0-a568-b8559f1c3983 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:36.768249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a7adab44-3a86-46e0-a568-b8559f1c3983 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.149155 Nov 08 17:59:36.768810 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1200/2401] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:36 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:36.872992 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:36.873641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:36.879827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:36.880261 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:36.881027 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:36.881481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:36.939052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:36.947167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:36.949289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:36.950404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-edd11fa8-1626-495c-bf03-1adb5517bc65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082006 Nov 08 17:59:36.950983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1202/2402] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:37.785210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5e5a5921-32a5-421f-bfc5-7b46adec62f8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:37.785885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5e5a5921-32a5-421f-bfc5-7b46adec62f8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:37.792288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e5a5921-32a5-421f-bfc5-7b46adec62f8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:37.792727 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e5a5921-32a5-421f-bfc5-7b46adec62f8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:37.793516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e5a5921-32a5-421f-bfc5-7b46adec62f8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:37.793958 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e5a5921-32a5-421f-bfc5-7b46adec62f8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:37.919738 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5e5a5921-32a5-421f-bfc5-7b46adec62f8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:37.927314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5e5a5921-32a5-421f-bfc5-7b46adec62f8 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145973 Nov 08 17:59:37.927886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1201/2403] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:37 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:37.968607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:37.969236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:37.975630 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:37.976332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:37.977085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:37.977507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:38.037663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:38.046141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:38.047652 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:38.048765 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fde80dda-b989-4fcc-8036-451cbcb4b171 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084515 Nov 08 17:59:38.049333 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1203/2404] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:38.943704 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fe76f673-dd61-4124-830b-ee9aa23d5844 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:38.944290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fe76f673-dd61-4124-830b-ee9aa23d5844 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:38.951014 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe76f673-dd61-4124-830b-ee9aa23d5844 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:38.951453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe76f673-dd61-4124-830b-ee9aa23d5844 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:38.952217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe76f673-dd61-4124-830b-ee9aa23d5844 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:38.952648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe76f673-dd61-4124-830b-ee9aa23d5844 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:39.067046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:39.067681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:39.073800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:39.074238 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:39.075095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:39.075495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:39.083231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fe76f673-dd61-4124-830b-ee9aa23d5844 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:39.091434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fe76f673-dd61-4124-830b-ee9aa23d5844 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151464 Nov 08 17:59:39.092000 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1202/2405] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:38 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:39.133847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:39.142029 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:39.143533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:39.144668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-af1d5568-99c9-4b14-817b-43094657df4e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081318 Nov 08 17:59:39.145216 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1204/2406] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:40.108978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ba6df810-cd71-4c16-8bcf-64c6b299f5cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:40.109631 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ba6df810-cd71-4c16-8bcf-64c6b299f5cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:40.115828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba6df810-cd71-4c16-8bcf-64c6b299f5cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:40.116268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba6df810-cd71-4c16-8bcf-64c6b299f5cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:40.117023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba6df810-cd71-4c16-8bcf-64c6b299f5cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:40.117448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ba6df810-cd71-4c16-8bcf-64c6b299f5cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:40.162203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:40.162845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:40.169799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:40.170265 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:40.171064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:40.171495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:40.234674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:40.243105 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:40.244572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:40.245694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-26127432-fd2b-41aa-945f-9f3e186cf138 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087315 Nov 08 17:59:40.246258 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1205/2407] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:40.269501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ba6df810-cd71-4c16-8bcf-64c6b299f5cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:40.277152 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ba6df810-cd71-4c16-8bcf-64c6b299f5cb tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.172684 Nov 08 17:59:40.277713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1203/2408] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:40 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:41.264848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:41.265526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:41.271880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:41.272324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:41.273094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:41.273526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:41.294369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-197f3705-a07a-433e-bd0c-cb3fbb33cd17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:41.295026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-197f3705-a07a-433e-bd0c-cb3fbb33cd17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:41.301701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-197f3705-a07a-433e-bd0c-cb3fbb33cd17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:41.302139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-197f3705-a07a-433e-bd0c-cb3fbb33cd17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:41.303028 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-197f3705-a07a-433e-bd0c-cb3fbb33cd17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:41.303454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-197f3705-a07a-433e-bd0c-cb3fbb33cd17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:41.447766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-197f3705-a07a-433e-bd0c-cb3fbb33cd17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:41.456137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-197f3705-a07a-433e-bd0c-cb3fbb33cd17 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.165391 Nov 08 17:59:41.456722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1204/2409] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:41 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:59:41.496663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:41.505633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:41.507150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:41.508281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-39f0f991-41ca-4cb1-9b64-c8706a39f67a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.247991 Nov 08 17:59:41.508828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1206/2410] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:42.473960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-67f5117f-930a-45cc-bc58-14b8acc79bba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:42.474602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-67f5117f-930a-45cc-bc58-14b8acc79bba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:42.481682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67f5117f-930a-45cc-bc58-14b8acc79bba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:42.482276 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67f5117f-930a-45cc-bc58-14b8acc79bba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:42.483114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67f5117f-930a-45cc-bc58-14b8acc79bba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:42.483552 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67f5117f-930a-45cc-bc58-14b8acc79bba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:42.525399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:42.526046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:42.533025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:42.533724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:42.534232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:42.534687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:42.601179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:42.609520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:42.611051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:42.612179 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c01682df-8b3f-4364-933c-6d6782a3cea3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.090415 Nov 08 17:59:42.612733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1207/2411] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:42.635074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-67f5117f-930a-45cc-bc58-14b8acc79bba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:42.643482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-67f5117f-930a-45cc-bc58-14b8acc79bba tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.174100 Nov 08 17:59:42.644046 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1205/2412] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:42 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:43.631186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:43.631796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:43.638687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:43.639283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:43.640048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:43.640481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:43.659965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e795d49d-befa-4594-a774-b389717dad70 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:43.660568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e795d49d-befa-4594-a774-b389717dad70 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:43.666385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e795d49d-befa-4594-a774-b389717dad70 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:43.666888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e795d49d-befa-4594-a774-b389717dad70 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:43.667645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e795d49d-befa-4594-a774-b389717dad70 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:43.668069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e795d49d-befa-4594-a774-b389717dad70 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:43.698980 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:43.707830 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:43.709342 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:43.710514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5e2f11c3-c2cd-4db0-8074-f3ee23581648 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083035 Nov 08 17:59:43.711063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1208/2413] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:43 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:43.796384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e795d49d-befa-4594-a774-b389717dad70 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:43.804070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e795d49d-befa-4594-a774-b389717dad70 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147717 Nov 08 17:59:43.804671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1206/2414] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:43 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:59:44.728461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:44.729047 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:44.735008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:44.735569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:44.736336 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:44.736770 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:44.794762 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:44.802928 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:44.804415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:44.805535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c6b316b1-116a-4293-9563-d41ff9410a19 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081185 Nov 08 17:59:44.806074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1209/2415] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:44.820719 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-17baa057-9942-4e1d-8d86-b3f4e4ab680c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:44.821312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-17baa057-9942-4e1d-8d86-b3f4e4ab680c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:44.827635 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17baa057-9942-4e1d-8d86-b3f4e4ab680c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:44.828073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17baa057-9942-4e1d-8d86-b3f4e4ab680c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:44.828831 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17baa057-9942-4e1d-8d86-b3f4e4ab680c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:44.829257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-17baa057-9942-4e1d-8d86-b3f4e4ab680c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:44.960985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-17baa057-9942-4e1d-8d86-b3f4e4ab680c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:44.969265 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-17baa057-9942-4e1d-8d86-b3f4e4ab680c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152144 Nov 08 17:59:44.969828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1207/2416] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:44 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 17:59:45.823118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:45.823724 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:45.830637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:45.831076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:45.831837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:45.832270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:45.890305 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:45.898345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:45.899852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:45.900972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-62c4f2ee-0043-459c-b121-a13321116e2d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081566 Nov 08 17:59:45.901517 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1210/2417] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:45.986409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5503d8ec-d5ac-4c71-9b63-87db54509e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:45.987041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5503d8ec-d5ac-4c71-9b63-87db54509e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:45.993353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5503d8ec-d5ac-4c71-9b63-87db54509e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:45.993794 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5503d8ec-d5ac-4c71-9b63-87db54509e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:45.994602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5503d8ec-d5ac-4c71-9b63-87db54509e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:45.995035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5503d8ec-d5ac-4c71-9b63-87db54509e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:46.121674 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5503d8ec-d5ac-4c71-9b63-87db54509e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:46.130091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5503d8ec-d5ac-4c71-9b63-87db54509e3e tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147225 Nov 08 17:59:46.130708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1208/2418] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:45 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:46.919523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:46.920121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:46.926734 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:46.927184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:46.927996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:46.928427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:46.989899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:46.998775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:47.000680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:47.001854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c7c3e46b-edb7-45e4-bcfe-3e2bf1d4a2a3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086333 Nov 08 17:59:47.002410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1211/2419] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:47.147192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0e0e8ab8-711c-4199-b1e7-617beed9b001 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:47.147795 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0e0e8ab8-711c-4199-b1e7-617beed9b001 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:47.154034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e0e8ab8-711c-4199-b1e7-617beed9b001 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:47.154551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e0e8ab8-711c-4199-b1e7-617beed9b001 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:47.155515 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e0e8ab8-711c-4199-b1e7-617beed9b001 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:47.155951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0e0e8ab8-711c-4199-b1e7-617beed9b001 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:47.286882 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0e0e8ab8-711c-4199-b1e7-617beed9b001 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:47.294651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0e0e8ab8-711c-4199-b1e7-617beed9b001 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151194 Nov 08 17:59:47.295273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1209/2420] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:47 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:48.021404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:48.022053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:48.028487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:48.029129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:48.030032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:48.030497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:48.090513 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:48.098748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:48.100224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:48.101586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e07fd65b-8423-4517-a07e-f32ac60703e5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083907 Nov 08 17:59:48.102138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1212/2421] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:48.312470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4ca728e2-1ee1-4b38-abe5-b53cd4c35313 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:48.313034 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4ca728e2-1ee1-4b38-abe5-b53cd4c35313 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:48.319333 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ca728e2-1ee1-4b38-abe5-b53cd4c35313 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:48.319783 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ca728e2-1ee1-4b38-abe5-b53cd4c35313 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:48.320572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ca728e2-1ee1-4b38-abe5-b53cd4c35313 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:48.321008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ca728e2-1ee1-4b38-abe5-b53cd4c35313 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:48.453280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ca728e2-1ee1-4b38-abe5-b53cd4c35313 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:48.460867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4ca728e2-1ee1-4b38-abe5-b53cd4c35313 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153164 Nov 08 17:59:48.461440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1210/2422] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:48 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:49.120921 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:49.121520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:49.127890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:49.128329 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:49.129090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:49.129515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:49.187524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:49.195616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:49.197088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:49.198310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f85d26ae-4ebf-41e5-8921-59a3c12e3d76 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081063 Nov 08 17:59:49.198911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1213/2423] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:49.477999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8d843356-ff95-4eef-8bc4-664dc17b2ae0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:49.478705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8d843356-ff95-4eef-8bc4-664dc17b2ae0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:49.484906 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d843356-ff95-4eef-8bc4-664dc17b2ae0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:49.485348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d843356-ff95-4eef-8bc4-664dc17b2ae0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:49.486118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d843356-ff95-4eef-8bc4-664dc17b2ae0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:49.486573 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d843356-ff95-4eef-8bc4-664dc17b2ae0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:49.613310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8d843356-ff95-4eef-8bc4-664dc17b2ae0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:49.620922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8d843356-ff95-4eef-8bc4-664dc17b2ae0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146801 Nov 08 17:59:49.621475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1211/2424] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:49 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:50.216736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:50.217439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:50.223694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:50.224143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:50.224918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:50.225360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:50.283471 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:50.291603 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:50.293104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:50.294234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-41a7330a-be1a-4cf2-9bfd-4635b2a76f86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081358 Nov 08 17:59:50.294850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1214/2425] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:50.638245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c1887d4f-79c0-4871-bf28-54d81eb6e6c9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:50.638904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c1887d4f-79c0-4871-bf28-54d81eb6e6c9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:50.645173 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1887d4f-79c0-4871-bf28-54d81eb6e6c9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:50.645615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1887d4f-79c0-4871-bf28-54d81eb6e6c9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:50.646376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1887d4f-79c0-4871-bf28-54d81eb6e6c9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:50.646857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c1887d4f-79c0-4871-bf28-54d81eb6e6c9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:50.780500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c1887d4f-79c0-4871-bf28-54d81eb6e6c9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:50.788675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c1887d4f-79c0-4871-bf28-54d81eb6e6c9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154063 Nov 08 17:59:50.789242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1212/2426] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:50 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:51.312316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:51.312853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:51.319468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:51.319904 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:51.320665 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:51.321092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:51.379607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:51.387779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:51.389301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:51.390411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c0afe7cd-609e-4758-8198-d24cd1bd02b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082019 Nov 08 17:59:51.390981 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1215/2427] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:51 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:51.805133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3652def5-0ad2-4079-bf77-c1b7b8bd8890 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:51.805720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3652def5-0ad2-4079-bf77-c1b7b8bd8890 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:51.811857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3652def5-0ad2-4079-bf77-c1b7b8bd8890 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:51.812299 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3652def5-0ad2-4079-bf77-c1b7b8bd8890 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:51.813053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3652def5-0ad2-4079-bf77-c1b7b8bd8890 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:51.813533 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3652def5-0ad2-4079-bf77-c1b7b8bd8890 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:51.942476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3652def5-0ad2-4079-bf77-c1b7b8bd8890 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:51.950138 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3652def5-0ad2-4079-bf77-c1b7b8bd8890 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.148637 Nov 08 17:59:51.950746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1213/2428] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:51 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:52.297089 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 17:59:52.297322 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 17:59:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 17:59:52.409990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:52.410615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:52.416813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:52.417253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:52.418013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:52.418441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:52.476424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:52.484657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:52.488093 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:52.489250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-55d7a47a-570e-48fd-8cc0-52146a9f5910 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083658 Nov 08 17:59:52.489789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1216/2429] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:52 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:52.967082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8bd93f3a-99d7-41df-9eda-99ab59339243 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:52.967696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8bd93f3a-99d7-41df-9eda-99ab59339243 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:52.974483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8bd93f3a-99d7-41df-9eda-99ab59339243 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:52.974942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8bd93f3a-99d7-41df-9eda-99ab59339243 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:52.975961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8bd93f3a-99d7-41df-9eda-99ab59339243 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:52.976401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8bd93f3a-99d7-41df-9eda-99ab59339243 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:53.108821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8bd93f3a-99d7-41df-9eda-99ab59339243 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:53.117344 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8bd93f3a-99d7-41df-9eda-99ab59339243 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153881 Nov 08 17:59:53.117901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1214/2430] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:52 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:53.507048 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:53.507655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:53.513917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:53.514363 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:53.515162 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:53.515594 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:53.573469 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:53.582042 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:53.583558 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:53.584679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c368c51b-ff18-4d6d-a9e0-4e24062b6e4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081357 Nov 08 17:59:53.585265 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1217/2431] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:53 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:54.135033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0935dad4-ed68-447c-9a09-1d20beba52b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:54.135653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0935dad4-ed68-447c-9a09-1d20beba52b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:54.142622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0935dad4-ed68-447c-9a09-1d20beba52b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:54.143105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0935dad4-ed68-447c-9a09-1d20beba52b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:54.143869 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0935dad4-ed68-447c-9a09-1d20beba52b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:54.144337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0935dad4-ed68-447c-9a09-1d20beba52b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:54.270315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0935dad4-ed68-447c-9a09-1d20beba52b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:54.277931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0935dad4-ed68-447c-9a09-1d20beba52b7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146843 Nov 08 17:59:54.278501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1215/2432] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:54 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:54.603413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:54.604018 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:54.610167 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:54.610644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:54.611412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:54.611842 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:54.674234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:54.683262 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:54.684746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:54.685868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-354f09e1-8437-4935-a5e9-ef0e0ea3d68b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086479 Nov 08 17:59:54.686413 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1218/2433] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:54 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:55.295105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8dbec409-7502-47b8-99ff-3d0618f3cada tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:55.295667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8dbec409-7502-47b8-99ff-3d0618f3cada tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:55.301754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8dbec409-7502-47b8-99ff-3d0618f3cada tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:55.302197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8dbec409-7502-47b8-99ff-3d0618f3cada tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:55.302985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8dbec409-7502-47b8-99ff-3d0618f3cada tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:55.303419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8dbec409-7502-47b8-99ff-3d0618f3cada tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:55.429992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8dbec409-7502-47b8-99ff-3d0618f3cada tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:55.437559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8dbec409-7502-47b8-99ff-3d0618f3cada tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146221 Nov 08 17:59:55.438126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1216/2434] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:55 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:55.703807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:55.704499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:55.710572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:55.711094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:55.711903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:55.712332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:55.770932 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:55.779066 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:55.780565 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:55.781688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-354f9bb9-dc28-421c-9f21-f4e62997ecdb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081656 Nov 08 17:59:55.782234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1219/2435] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:56.454188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ae84d320-f496-4c51-aabc-4e1e053876a0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:56.454808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ae84d320-f496-4c51-aabc-4e1e053876a0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:56.461473 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae84d320-f496-4c51-aabc-4e1e053876a0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:56.461910 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae84d320-f496-4c51-aabc-4e1e053876a0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:56.462703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae84d320-f496-4c51-aabc-4e1e053876a0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:56.463124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ae84d320-f496-4c51-aabc-4e1e053876a0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:56.597400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ae84d320-f496-4c51-aabc-4e1e053876a0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:56.605554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ae84d320-f496-4c51-aabc-4e1e053876a0 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154958 Nov 08 17:59:56.606120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1217/2436] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:56 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:56.800557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:56.801122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:56.807360 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:56.807806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:56.808567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:56.809001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:56.868576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:56.876636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:56.878129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:56.879291 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-33cc703f-17ae-47bb-b104-917b5e04a48e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082527 Nov 08 17:59:56.879854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1220/2437] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:56 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:57.622198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ccf8f768-24bb-4c48-b68a-926d2b7035b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:57.622896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ccf8f768-24bb-4c48-b68a-926d2b7035b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:57.629094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccf8f768-24bb-4c48-b68a-926d2b7035b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:57.629598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccf8f768-24bb-4c48-b68a-926d2b7035b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:57.630355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccf8f768-24bb-4c48-b68a-926d2b7035b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:57.630804 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ccf8f768-24bb-4c48-b68a-926d2b7035b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:57.757623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ccf8f768-24bb-4c48-b68a-926d2b7035b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:57.765440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ccf8f768-24bb-4c48-b68a-926d2b7035b9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.146894 Nov 08 17:59:57.765999 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1218/2438] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:57 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:57.896800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:57.897339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:57.904121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:57.904555 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:57.905311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:57.905737 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:57.963060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:57.971009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:57.972488 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:57.973601 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dceed1f4-0a28-4bac-9415-acf7b001280c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080496 Nov 08 17:59:57.974147 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1221/2439] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:57 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 17:59:58.782471 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-96d6d02f-46b3-4d70-8ce3-81a873802921 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:58.783090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-96d6d02f-46b3-4d70-8ce3-81a873802921 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:58.789828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96d6d02f-46b3-4d70-8ce3-81a873802921 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:58.790265 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96d6d02f-46b3-4d70-8ce3-81a873802921 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:58.791053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96d6d02f-46b3-4d70-8ce3-81a873802921 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:58.791479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96d6d02f-46b3-4d70-8ce3-81a873802921 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:58.925284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-96d6d02f-46b3-4d70-8ce3-81a873802921 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:58.933490 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-96d6d02f-46b3-4d70-8ce3-81a873802921 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.154604 Nov 08 17:59:58.934040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1219/2440] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:58 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 17:59:58.993648 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:58.994269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:59.000636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:59.001079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:59.001853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:59.002334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:59.061270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:59.069556 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:59.071174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 17:59:59.072298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-55062b5c-03e3-431b-9df9-f749594d9976 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083421 Nov 08 17:59:59.072854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1222/2441] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 17:59:58 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 17:59:59.950724 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a9f9b23b-f952-458c-a73f-2dc5f50fce4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 17:59:59.951328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a9f9b23b-f952-458c-a73f-2dc5f50fce4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 17:59:59.957438 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9f9b23b-f952-458c-a73f-2dc5f50fce4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:59.957885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9f9b23b-f952-458c-a73f-2dc5f50fce4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 17:59:59.958676 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9f9b23b-f952-458c-a73f-2dc5f50fce4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 17:59:59.959108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a9f9b23b-f952-458c-a73f-2dc5f50fce4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:00.090899 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:00.091520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:00.091720 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a9f9b23b-f952-458c-a73f-2dc5f50fce4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:00.097701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:00.098150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:00.098965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:00.099390 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a9f9b23b-f952-458c-a73f-2dc5f50fce4c tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152308 Nov 08 18:00:00.099501 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:00.099957 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1220/2442] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 17:59:59 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:00.161571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:00.169759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:00.171381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:00.172550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c52e8695-a31b-4c53-8f3f-0e3f39286ead tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086119 Nov 08 18:00:00.173094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1223/2443] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:00 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:01.117037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-96acbc6d-4a9a-440f-9f0c-405c30dd0843 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:01.117639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-96acbc6d-4a9a-440f-9f0c-405c30dd0843 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:01.123914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96acbc6d-4a9a-440f-9f0c-405c30dd0843 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:01.124355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96acbc6d-4a9a-440f-9f0c-405c30dd0843 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:01.125114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96acbc6d-4a9a-440f-9f0c-405c30dd0843 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:01.125544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-96acbc6d-4a9a-440f-9f0c-405c30dd0843 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:01.191250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:01.191857 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:01.198789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:01.199240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:01.200014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:01.200455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:01.271927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:01.276990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-96acbc6d-4a9a-440f-9f0c-405c30dd0843 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:01.280810 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:01.282301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:01.283461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9fbe2abd-5586-4453-92d3-f457266c0934 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.095937 Nov 08 18:00:01.284008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1224/2444] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:01 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:00:01.284576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-96acbc6d-4a9a-440f-9f0c-405c30dd0843 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.171192 Nov 08 18:00:01.285162 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1221/2445] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:01 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:02.301146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3df5caa6-c8c5-40b9-930e-3091cbf06aea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:02.301693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:02.302080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3df5caa6-c8c5-40b9-930e-3091cbf06aea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:02.302203 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:02.308077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3df5caa6-c8c5-40b9-930e-3091cbf06aea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:02.308243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:02.308525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3df5caa6-c8c5-40b9-930e-3091cbf06aea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:02.308653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:02.309543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3df5caa6-c8c5-40b9-930e-3091cbf06aea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:02.309667 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:02.309764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3df5caa6-c8c5-40b9-930e-3091cbf06aea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:02.309858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:02.389868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:02.398215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:02.400238 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:02.401352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4ce8a678-bc07-4545-a7b0-a8b18e3b0d39 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.103544 Nov 08 18:00:02.401914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1222/2446] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:02 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:00:02.460722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3df5caa6-c8c5-40b9-930e-3091cbf06aea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:02.468939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3df5caa6-c8c5-40b9-930e-3091cbf06aea tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.171600 Nov 08 18:00:02.469492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1225/2447] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:02 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:03.419645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:03.420241 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:03.426540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:03.426982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:03.427737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:03.428161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:03.486489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:03.487067 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9fd4de54-f58e-4efa-b7a4-28f5b0ec30db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:03.487673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9fd4de54-f58e-4efa-b7a4-28f5b0ec30db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:03.494033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fd4de54-f58e-4efa-b7a4-28f5b0ec30db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:03.494501 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fd4de54-f58e-4efa-b7a4-28f5b0ec30db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:03.495414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:03.495986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fd4de54-f58e-4efa-b7a4-28f5b0ec30db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:03.496542 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9fd4de54-f58e-4efa-b7a4-28f5b0ec30db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:03.496921 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:03.498079 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-356aaa4b-beca-4878-b0a3-5ecd572be828 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082817 Nov 08 18:00:03.498678 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1223/2448] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:03 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:03.623548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9fd4de54-f58e-4efa-b7a4-28f5b0ec30db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:03.631133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9fd4de54-f58e-4efa-b7a4-28f5b0ec30db tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147703 Nov 08 18:00:03.631686 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1226/2449] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:03 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:00:04.516612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:04.517192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:04.523417 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:04.523856 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:04.524605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:04.525029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:04.586860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:04.595253 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:04.596818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:04.597934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-367ad68d-e994-4d5e-aa8e-ed45aaf786d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085000 Nov 08 18:00:04.598544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1224/2450] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:04 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:04.647625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-17ed95fa-10cb-4ca9-be4e-89ca68bf3a1d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:04.648234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-17ed95fa-10cb-4ca9-be4e-89ca68bf3a1d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:04.654669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17ed95fa-10cb-4ca9-be4e-89ca68bf3a1d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:04.655130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17ed95fa-10cb-4ca9-be4e-89ca68bf3a1d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:04.655882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17ed95fa-10cb-4ca9-be4e-89ca68bf3a1d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:04.656316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-17ed95fa-10cb-4ca9-be4e-89ca68bf3a1d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:04.786842 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-17ed95fa-10cb-4ca9-be4e-89ca68bf3a1d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:04.795676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-17ed95fa-10cb-4ca9-be4e-89ca68bf3a1d tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.151690 Nov 08 18:00:04.796232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1227/2451] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:04 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:05.616187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:05.616794 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:05.623052 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:05.623491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:05.624248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:05.624676 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:05.682936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:05.691328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:05.693893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:05.694045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3c4bae32-4214-435b-a25d-4c6364d1733d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081466 Nov 08 18:00:05.694606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1225/2452] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:05 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:05.812406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-301ee4b1-9148-4741-8f1d-3bdad814b7a7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:05.813149 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-301ee4b1-9148-4741-8f1d-3bdad814b7a7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:05.819377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-301ee4b1-9148-4741-8f1d-3bdad814b7a7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:05.819819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-301ee4b1-9148-4741-8f1d-3bdad814b7a7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:05.820575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-301ee4b1-9148-4741-8f1d-3bdad814b7a7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:05.821005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-301ee4b1-9148-4741-8f1d-3bdad814b7a7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:05.954116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-301ee4b1-9148-4741-8f1d-3bdad814b7a7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:05.961969 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-301ee4b1-9148-4741-8f1d-3bdad814b7a7 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153128 Nov 08 18:00:05.962548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1228/2453] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:05 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:06.713162 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:06.714802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:06.721130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:06.721590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:06.722350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:06.722799 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:06.783829 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:06.793693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:06.795279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:06.796411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-db6b0393-9ab1-4a46-b6bc-99541c7d9c86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.087584 Nov 08 18:00:06.796978 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1226/2454] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:06 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:06.979168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fc913f86-fb46-4137-8365-0dd9ce7911d3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:06.979938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fc913f86-fb46-4137-8365-0dd9ce7911d3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:06.986186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc913f86-fb46-4137-8365-0dd9ce7911d3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:06.986664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc913f86-fb46-4137-8365-0dd9ce7911d3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:06.987472 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc913f86-fb46-4137-8365-0dd9ce7911d3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:06.987868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fc913f86-fb46-4137-8365-0dd9ce7911d3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:07.121293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fc913f86-fb46-4137-8365-0dd9ce7911d3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:07.129011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fc913f86-fb46-4137-8365-0dd9ce7911d3 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.153853 Nov 08 18:00:07.129595 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1229/2455] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:06 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:07.813998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:07.814629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:07.820784 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:07.821221 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:07.821973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:07.822400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:07.885620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:07.895668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:07.897282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:07.898652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6e860138-e3a6-4805-b4b6-2fa9d9898d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.088284 Nov 08 18:00:07.899250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1227/2456] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:07 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:00:08.146324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3ec138e3-d8a9-4a54-a54f-41b3afa26780 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:08.146962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3ec138e3-d8a9-4a54-a54f-41b3afa26780 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:08.153911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ec138e3-d8a9-4a54-a54f-41b3afa26780 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:08.154359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ec138e3-d8a9-4a54-a54f-41b3afa26780 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:08.155163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ec138e3-d8a9-4a54-a54f-41b3afa26780 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:08.155600 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3ec138e3-d8a9-4a54-a54f-41b3afa26780 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:08.286280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3ec138e3-d8a9-4a54-a54f-41b3afa26780 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:08.294880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3ec138e3-d8a9-4a54-a54f-41b3afa26780 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.152198 Nov 08 18:00:08.295452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1230/2457] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:08 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:08.918267 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:08.918944 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:08.925187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:08.928144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:08.928144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:08.928144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:09.038658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:09.046750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:09.048250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:09.049362 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e9eccbec-858a-4f18-9c48-1a4b3078fcb7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.135083 Nov 08 18:00:09.049911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1228/2458] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:08 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:00:09.311549 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-eebb1ae4-00ea-4ba9-9e6c-670177494287 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:09.312680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-eebb1ae4-00ea-4ba9-9e6c-670177494287 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:09.318962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eebb1ae4-00ea-4ba9-9e6c-670177494287 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:09.319405 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eebb1ae4-00ea-4ba9-9e6c-670177494287 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:09.320173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eebb1ae4-00ea-4ba9-9e6c-670177494287 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:09.320602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eebb1ae4-00ea-4ba9-9e6c-670177494287 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:09.445550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-eebb1ae4-00ea-4ba9-9e6c-670177494287 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:09.453356 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-eebb1ae4-00ea-4ba9-9e6c-670177494287 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.145540 Nov 08 18:00:09.453924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1231/2459] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:09 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:10.067820 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:10.068432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:10.075156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:10.075601 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:10.076366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:10.076793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:10.136402 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:10.144663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:10.146174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:10.147379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9d1505a4-9808-4d32-9a47-28f5327ad8e4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083305 Nov 08 18:00:10.147955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1229/2460] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:10 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:10.470065 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-704567b1-55e3-421f-8461-cf56d2557af9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:10.470693 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-704567b1-55e3-421f-8461-cf56d2557af9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:10.477140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-704567b1-55e3-421f-8461-cf56d2557af9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:10.477580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-704567b1-55e3-421f-8461-cf56d2557af9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:10.478338 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-704567b1-55e3-421f-8461-cf56d2557af9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:10.478816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-704567b1-55e3-421f-8461-cf56d2557af9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:10.655590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-704567b1-55e3-421f-8461-cf56d2557af9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:10.663141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-704567b1-55e3-421f-8461-cf56d2557af9 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.196731 Nov 08 18:00:10.663704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1232/2461] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:10 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:11.167545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:11.168150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:11.174960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:11.175401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:11.176166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:11.176598 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:11.235242 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:11.243339 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:11.244828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:11.245949 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cdecc68f-a559-4ffb-bce4-a7a9d40f454e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082098 Nov 08 18:00:11.246522 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1230/2462] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:11 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:11.679060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a8ba9949-5a52-4659-b24e-dd608c83e226 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:11.679668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a8ba9949-5a52-4659-b24e-dd608c83e226 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] [instance: 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:11.686632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8ba9949-5a52-4659-b24e-dd608c83e226 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:11.687165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8ba9949-5a52-4659-b24e-dd608c83e226 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:11.688012 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8ba9949-5a52-4659-b24e-dd608c83e226 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:11.688555 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a8ba9949-5a52-4659-b24e-dd608c83e226 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:11.815254 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a8ba9949-5a52-4659-b24e-dd608c83e226 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5340065597ba44f9b9798a5fcb5fe411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ba6928417b4b3bb1e4222ed1a7b3dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:11.823073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a8ba9949-5a52-4659-b24e-dd608c83e226 tempest-VolumesSnapshotTestJSON-685498911 tempest-VolumesSnapshotTestJSON-685498911-project] 10.222.0.18 "GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe" status: 200 len: 1560 microversion: 2.1 time: 0.147643 Nov 08 18:00:11.823636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1233/2463] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:00:11 2021] GET /compute/v2.1/servers/6e6c9295-0da3-43bd-b2fa-5709f1c39dbe => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:00:12.264090 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:12.264675 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:12.270770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:12.271209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:12.271962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:12.272388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:12.335199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:12.343839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:12.345317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:12.346431 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9b220562-41fe-4f74-bd81-dfe1d5640766 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086613 Nov 08 18:00:12.347008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1231/2464] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:12 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:13.364643 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:13.365246 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:13.371511 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:13.371954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:13.373343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:13.373789 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:13.430777 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:13.439351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:13.440848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:13.441970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3f86ee82-3c77-4609-b336-1dfa8597bc59 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081095 Nov 08 18:00:13.442531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1234/2465] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:13 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:14.460098 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:14.460706 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:14.467412 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:14.467864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:14.468637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:14.469077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:14.527063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:14.536029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:14.537518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:14.538660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d98179f1-1339-4be7-b9b7-933de43fa259 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082411 Nov 08 18:00:14.539214 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1232/2466] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:14 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:15.556846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:15.557453 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:15.563581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:15.564026 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:15.564806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:15.565245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:15.626999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:15.635850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:15.637353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:15.638655 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-406db81e-2422-4c09-92cd-1ab22d884ed7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.085509 Nov 08 18:00:15.639212 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1235/2467] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:15 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:16.656851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:16.657445 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:16.663645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:16.664081 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:16.664836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:16.665262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:16.722691 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:16.731016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:16.733524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:16.734671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3546ae8b-4980-4791-9d0b-a549e908d487 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081480 Nov 08 18:00:16.735420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1233/2468] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:16 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:17.753039 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:17.753632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:17.759906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:17.760350 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:17.761111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:17.761546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:17.819661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:17.828334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:17.829824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:17.830983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bb4a90c6-ccdb-4ff0-9532-2393f045558a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081722 Nov 08 18:00:17.831530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1236/2469] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:17 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:18.848955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:18.849562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:18.856094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:18.857286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:18.858228 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:18.858685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:18.920575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:18.928576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:18.930055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:18.931205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-76630715-ea72-4468-ab06-e2514dff70b6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086025 Nov 08 18:00:18.931762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1234/2470] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:18 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:19.948800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:19.949395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:19.956185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:19.956634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:19.957407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:19.957876 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:20.017224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:20.025446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:20.026962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:20.028090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bd4c6094-df5f-43b8-9e1d-a098e6819771 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083002 Nov 08 18:00:20.029227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1237/2471] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:19 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:21.046701 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:21.047300 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:21.053588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:21.054032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:21.054824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:21.055278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:21.113103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:21.121078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:21.125947 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:21.127123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9bab590e-3421-4d4d-8cf8-f508bd4e766c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084323 Nov 08 18:00:21.127690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1235/2472] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:21 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:22.144971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:22.145569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:22.157074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:22.157514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:22.158283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:22.158740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:22.217201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:22.225316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:22.227085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:22.228204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bb51c2e5-db9b-47b4-bc25-e33733820aaa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.086960 Nov 08 18:00:22.228817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1238/2473] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:22 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:23.246873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:23.247447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:23.253745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:23.254180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:23.255094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:23.255521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:23.315094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:23.323146 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:23.324625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:23.326041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-09c23659-23b6-4db0-92df-0567adab30dd tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082810 Nov 08 18:00:23.326633 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1236/2474] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:23 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:24.344448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:24.344995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:24.351641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:24.352087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:24.352850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:24.353282 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:24.411087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:24.419681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:24.421168 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:24.422292 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bc8a42da-41a7-41e4-ba98-f21321504414 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081962 Nov 08 18:00:24.422869 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1239/2475] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:24 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:25.440148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:25.440789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:25.447011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:25.447452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:25.448227 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:25.448657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:25.509210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:25.517642 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:25.519180 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:25.520297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b29dab8c-1fa8-4276-8e63-845f404c2e09 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083858 Nov 08 18:00:25.520848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1237/2476] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:25 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:26.538979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:26.539613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:26.546395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:26.546871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:26.547641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:26.548080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:26.606215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:26.614985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:26.616514 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:26.617639 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8520fe38-413e-4f82-be55-b44a012f1aa4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082357 Nov 08 18:00:26.618201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1240/2477] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:26 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:27.636387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:27.636998 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:27.643954 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:27.644399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:27.645160 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:27.645591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:27.704936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:27.713040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:27.714563 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:27.715717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6a901fe1-83ab-4a44-80df-871de68eb727 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083074 Nov 08 18:00:27.716278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1238/2478] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:27 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:28.733238 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:28.733844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:28.740180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:28.740502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:28.741258 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:28.741689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:28.800404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:28.808306 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:28.809775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:28.810973 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4c538b10-a865-40ad-b1e6-de9e3433eb01 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081825 Nov 08 18:00:28.811515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1241/2479] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:28 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:29.526672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:00:29.526937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:00:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:00:29.829935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:29.830490 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:29.836621 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:29.837060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:29.837825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:29.838251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:29.895746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:29.903699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:29.905324 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:29.906432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d43779e1-8f57-4026-8bda-fcedabc3ca8b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081094 Nov 08 18:00:29.907007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1239/2480] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:29 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:30.924454 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:30.925051 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:30.931308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:30.931748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:30.932509 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:30.932938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:30.992171 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:31.000557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:31.002055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:31.003205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2fc0ba2e-0a83-4530-8c7b-2bd13d2b82a5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082472 Nov 08 18:00:31.003974 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1242/2481] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:30 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:32.021580 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:32.022103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:32.028363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:32.028808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:32.030085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:32.030540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:32.091067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:32.099577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:32.101341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:32.102476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2259ff63-43be-45f9-8c41-f985a2e810d3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.084645 Nov 08 18:00:32.103037 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1240/2482] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:32 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:33.120545 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:33.121151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:33.128113 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:33.128561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:33.129319 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:33.129752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:33.188128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:33.196200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:33.197692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:33.198840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-74f6fe26-09ac-4e02-afba-80f4f60db1ff tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081970 Nov 08 18:00:33.199380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1243/2483] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:33 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:34.216233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:34.216831 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:34.223225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:34.223671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:34.224436 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:34.224865 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:34.283247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:34.291279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:34.292777 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:34.293898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b1ac4eb0-7959-41d9-b02e-6cd98980d035 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081447 Nov 08 18:00:34.294477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1241/2484] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:34 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:35.312005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:35.312606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:35.318898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:35.319343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:35.320111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:35.320543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:35.379676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:35.387900 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:35.389546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:35.390708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bdbaa1dc-911b-425d-923c-e129164d5c91 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083040 Nov 08 18:00:35.391264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1244/2485] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:35 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:00:36.408746 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:36.409366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:36.415695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:36.416136 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:36.416889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:36.417394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:36.476170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:36.485033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:36.486550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:36.487658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dceccc21-e0bb-4ec8-b1af-b09bafecc261 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083077 Nov 08 18:00:36.488207 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1242/2486] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:36 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:37.505201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:37.505879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:37.512141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:37.512580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:37.513337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:37.513763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:37.571367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:37.580006 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:37.581476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:37.582627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e2e93b87-066d-4f3a-ab8a-323b7749df5e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081048 Nov 08 18:00:37.583174 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1245/2487] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:37 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:38.602317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:38.616147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:38.616147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:38.616147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:38.616147 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:38.616569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:38.676009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:38.684351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:38.685897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:38.687689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-20fd0f76-f0d7-44c7-969e-486b93020f6a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.089829 Nov 08 18:00:38.688246 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1243/2488] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:38 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:39.706271 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:39.706918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:39.713178 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:39.713623 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:39.714417 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:39.714874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:39.772915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:39.781235 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:39.782750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:39.783878 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-799944a0-0f81-4f80-b3a0-38ebcefc3b9c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082020 Nov 08 18:00:39.784428 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1246/2489] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:39 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:40.801626 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:40.802220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:40.808406 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:40.808848 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:40.809610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:40.810041 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:40.867945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:40.875851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:40.877328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:40.878449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-994fb849-31f8-40f5-99ed-dda9881c57b4 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080479 Nov 08 18:00:40.879019 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1244/2490] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:40 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:41.896128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:41.896718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:41.902952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:41.903396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:41.904160 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:41.904591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:41.963942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:41.972516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:41.973994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:41.975388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c701b986-82bb-45ef-80b4-0463aab7c5bf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082705 Nov 08 18:00:41.975958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1247/2491] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:41 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:42.992942 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:42.993546 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:42.999651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:43.000800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:43.001581 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:43.002011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:43.060557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:43.069342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:43.070866 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:43.071993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-26e5e2fc-c0a3-44c5-adbe-b6c4ddd810b9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.082749 Nov 08 18:00:43.072540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1245/2492] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:42 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:44.089984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:44.090715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:44.096561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:44.096998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:44.097756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:44.098181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:44.155571 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:44.163716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:44.165200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:44.166345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-52c4d2f9-7963-4427-8b96-d0e04ed67856 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080261 Nov 08 18:00:44.166928 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1248/2493] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:44 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:45.183760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:45.184363 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:45.190768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:45.191215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:45.191982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:45.192413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:45.253042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:45.261059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:45.262607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:45.263725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7e87b8c0-4d87-482e-9c02-2090b2df9d73 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.083661 Nov 08 18:00:45.264283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1246/2494] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:45 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:46.282539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:46.283094 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:46.289437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:46.289875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:46.290679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:46.291107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:46.348508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:46.356764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:46.358240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:46.360019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f278f6d0-601d-4064-af5e-50649588570c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081201 Nov 08 18:00:46.360563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1249/2495] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:46 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:47.378542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:47.379191 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:47.385310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:47.385749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:47.386532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:47.386958 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:47.444458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:47.452622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:47.454296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:47.455455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9d4e2a2b-3a4b-4885-8221-86a31be1a51a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081079 Nov 08 18:00:47.456002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1247/2496] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:47 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:48.472960 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:48.473570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:48.480083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:48.480528 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:48.481289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:48.481727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:48.540185 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:48.548324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:48.549805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:48.550956 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1318016f-5653-46df-9220-d6b4ba511f53 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081776 Nov 08 18:00:48.551512 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1250/2497] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:48 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:49.568628 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:49.569229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:49.575455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:49.575922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:49.576685 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:49.577113 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:49.635110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:49.643828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:49.645316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:49.646436 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7cc82332-a14f-4bf4-9523-dd609573791e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.081522 Nov 08 18:00:49.647011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1248/2498] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:49 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:50.664994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:50.665576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:50.672418 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:50.672858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:50.673616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:50.674046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:50.730696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:50.739383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:50.740853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:50.741968 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-166580f1-d769-4d7b-8f00-5c7ee1b7f2a6 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 200 len: 1443 microversion: 2.20 time: 0.080632 Nov 08 18:00:50.742526 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1251/2499] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:50 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:50.759969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c8cc1672-6f05-4a4e-9106-70972f6ea321 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '.version_select at 0x7f06ec5be280>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:50.858764 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c8cc1672-6f05-4a4e-9106-70972f6ea321 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-336226364" status: 204 len: 0 microversion: 2.20 time: 0.102273 Nov 08 18:00:50.859986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1249/2500] 10.222.0.18 () {60 vars in 1258 bytes} [Mon Nov 8 18:00:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-336226364 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 08 18:00:51.887099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-442b6f48-a2ec-4371-8345-4fdc9c0c9735 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'create', calling method: .version_select at 0x7f06ec2094c0>, body: {"keypair": {"name": "tempest-keypair-888763827"}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:00:51.901731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-442b6f48-a2ec-4371-8345-4fdc9c0c9735 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 18:00:51.905433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-442b6f48-a2ec-4371-8345-4fdc9c0c9735 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for user d88ffa0544a14579bf1e045e795d551a and project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 18:00:52.130089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-442b6f48-a2ec-4371-8345-4fdc9c0c9735 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 18:00:52.133658 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.quota [None req-442b6f48-a2ec-4371-8345-4fdc9c0c9735 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for user d88ffa0544a14579bf1e045e795d551a and project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'key_pairs'} {{(pid=127762) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 18:00:52.146788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-442b6f48-a2ec-4371-8345-4fdc9c0c9735 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.263310 Nov 08 18:00:52.147319 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1252/2501] 10.222.0.18 () {62 vars in 1198 bytes} [Mon Nov 8 18:00:51 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 265 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 08 18:00:54.354225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1792138669", "imageRef": "eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34ca4a7c-c4ab-4bf8-99e5-603019d7c10d"}], "security_groups": [{"name": "tempest-securitygroup--1656537403"}], "key_name": "tempest-keypair-888763827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:00:54.459269 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.network.neutron [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] validate_networks() for [('34ca4a7c-c4ab-4bf8-99e5-603019d7c10d', None, None, None, None, None)] {{(pid=127763) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Nov 08 18:00:54.878884 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Flavor limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 08 18:00:54.879298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Image limits 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 08 18:00:54.879811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Flavor pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 08 18:00:54.880218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Image pref 0:0:0 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 08 18:00:54.880623 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.virt.hardware [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 08 18:00:54.888973 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:54.889409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:54.890927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:54.891372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:54.907197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 08 18:00:54.910984 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.quota [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Getting quotas for user d88ffa0544a14579bf1e045e795d551a and project 7801fb7e4cdc48f7af389d704485ca15. Resources: {'ram', 'instances', 'cores'} {{(pid=127763) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 08 18:00:54.921342 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Going to run 1 instances... {{(pid=127763) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 08 18:00:54.924298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb3a60ec-5787-43af-b7b0-d4ef5caf4d5f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 08 18:00:55.049881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6f739a2f-6afa-4769-9f92-a1a179638757 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.700360 Nov 08 18:00:55.050772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1250/2502] 10.222.0.18 () {62 vars in 1187 bytes} [Mon Nov 8 18:00:54 2021] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 08 18:00:55.060999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b70e137b-5aea-42ce-af78-6229c900f062 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:55.061614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b70e137b-5aea-42ce-af78-6229c900f062 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:55.116701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b70e137b-5aea-42ce-af78-6229c900f062 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:55.125367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b70e137b-5aea-42ce-af78-6229c900f062 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:55.127068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b70e137b-5aea-42ce-af78-6229c900f062 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:55.128151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b70e137b-5aea-42ce-af78-6229c900f062 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1281 microversion: 2.20 time: 0.071434 Nov 08 18:00:55.128694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1253/2503] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:55 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:56.147154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:56.147780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:56.154285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:56.154770 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:56.155542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:56.156011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:56.213057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:56.220913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:56.222401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:56.223511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-04d36f13-e732-4215-bb7b-3daa880073fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1285 microversion: 2.20 time: 0.080561 Nov 08 18:00:56.224068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1251/2504] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:56 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:57.241374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:57.241958 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:57.248467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:57.248910 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:57.249970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:57.250405 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:57.309430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:57.317945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:57.319532 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:57.320616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3d595438-a286-4081-a789-d3014e77a942 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1351 microversion: 2.20 time: 0.083073 Nov 08 18:00:57.321156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1254/2505] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:57 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:00:58.339069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:58.339702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:58.346547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:58.347024 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:58.347793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:58.348279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:58.487479 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:58.496857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:58.498488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:58.499829 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3192dd0a-a104-4539-a04b-a2c608e8f470 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1407 microversion: 2.20 time: 0.164316 Nov 08 18:00:58.501188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1252/2506] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:58 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:00:58.745683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-e1a67231-3a1a-42da-a758-d5283c8b496d req-1216022f-6a43-42df-9ba0-69ca2042347e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2d64fa-31c1-4d92-8770-5dc5259e5bd4", "tag": "ce41e60b-9d99-45cf-af89-099b2059efc1"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:00:58.747692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 18:00:58.747692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 18:00:58.756200 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-e1a67231-3a1a-42da-a758-d5283c8b496d req-1216022f-6a43-42df-9ba0-69ca2042347e service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:58.756657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-e1a67231-3a1a-42da-a758-d5283c8b496d req-1216022f-6a43-42df-9ba0-69ca2042347e service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:58.768681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-e1a67231-3a1a-42da-a758-d5283c8b496d req-1216022f-6a43-42df-9ba0-69ca2042347e service nova] Creating event network-changed:ce41e60b-9d99-45cf-af89-099b2059efc1 for instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 on hv-cinder-81689 Nov 08 18:00:58.775317 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-e1a67231-3a1a-42da-a758-d5283c8b496d req-1216022f-6a43-42df-9ba0-69ca2042347e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104428 Nov 08 18:00:58.775971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1255/2507] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 18:00:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 18:00:59.518153 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:00:59.518765 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:00:59.524961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:59.525400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:59.526158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:00:59.526604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:00:59.659814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:59.667501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:59.669002 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:00:59.670124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3ee4f01b-d994-4f31-bca8-c3316703ad61 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1407 microversion: 2.20 time: 0.155812 Nov 08 18:00:59.670717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1253/2508] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:00:59 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:01:00.690405 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:01:00.691058 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:00.697082 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:00.697530 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:00.698295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:00.698760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:00.830935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:00.838627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:00.840121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:00.841223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c09c7b12-1ea6-4df7-832d-5e00fc8ba068 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1407 microversion: 2.20 time: 0.156094 Nov 08 18:01:00.841773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1256/2509] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:01:00 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:01:01.859622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:01:01.860311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:01.866437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:01.866900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:01.867656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:01.868080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:01.996572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:02.004265 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:02.005745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:02.006847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-08306264-0d4d-4319-866e-1c6b05912d65 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1407 microversion: 2.20 time: 0.151448 Nov 08 18:01:02.007399 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1254/2510] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:01:01 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:01:03.024529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:01:03.025143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:03.032085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:03.032529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:03.033296 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:03.033729 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:03.162727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:03.170481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:03.172896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:03.173383 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-26530f2c-c507-484a-b03e-e59e034f5b4d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1407 microversion: 2.20 time: 0.152559 Nov 08 18:01:03.173928 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1257/2511] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:01:03 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:01:03.361514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-b53ec6d6-5681-4887-8999-2692122ed2bc req-b2a950d7-4efe-4516-82dd-45f7f59b52e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2d64fa-31c1-4d92-8770-5dc5259e5bd4", "name": "network-vif-plugged", "status": "completed", "tag": "ce41e60b-9d99-45cf-af89-099b2059efc1"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:03.363177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 18:01:03.363177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 18:01:03.369824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-b53ec6d6-5681-4887-8999-2692122ed2bc req-b2a950d7-4efe-4516-82dd-45f7f59b52e8 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:03.370257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-b53ec6d6-5681-4887-8999-2692122ed2bc req-b2a950d7-4efe-4516-82dd-45f7f59b52e8 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:03.380615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-b53ec6d6-5681-4887-8999-2692122ed2bc req-b2a950d7-4efe-4516-82dd-45f7f59b52e8 service nova] Creating event network-vif-plugged:ce41e60b-9d99-45cf-af89-099b2059efc1 for instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 on hv-cinder-81689 Nov 08 18:01:03.386408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-b53ec6d6-5681-4887-8999-2692122ed2bc req-b2a950d7-4efe-4516-82dd-45f7f59b52e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081552 Nov 08 18:01:03.387096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1255/2512] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 18:01:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:01:04.192155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:01:04.192881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:04.199203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:04.199642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:04.200427 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:04.200857 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:04.326140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:04.334034 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:04.335583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:04.336672 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a4f7cef4-dc3f-4699-84ea-7e77109b2be3 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1407 microversion: 2.20 time: 0.148218 Nov 08 18:01:04.337214 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1258/2513] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:01:04 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:01:05.356421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:01:05.357025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:05.363782 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:05.364225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:05.364986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:05.365421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:05.494148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:05.502418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:05.503965 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:01:05.505099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c758401e-b878-43a9-9229-4bd65de3e6ba tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1599 microversion: 2.20 time: 0.153317 Nov 08 18:01:05.505660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1256/2514] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:01:05 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:01:05.522070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f9494123-8b2b-41e6-b3c7-2c78a819e92f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:01:05.522618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f9494123-8b2b-41e6-b3c7-2c78a819e92f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:05.529008 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9494123-8b2b-41e6-b3c7-2c78a819e92f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:05.529461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9494123-8b2b-41e6-b3c7-2c78a819e92f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:05.530259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9494123-8b2b-41e6-b3c7-2c78a819e92f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:05.530749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f9494123-8b2b-41e6-b3c7-2c78a819e92f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:05.606993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f9494123-8b2b-41e6-b3c7-2c78a819e92f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088428 Nov 08 18:01:05.607531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1259/2515] 10.222.0.18 () {60 vars in 1315 bytes} [Mon Nov 8 18:01:05 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 08 18:01:06.846914 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f120fd17-bc48-4a02-85b7-2570058aa879 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:06.847819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f120fd17-bc48-4a02-85b7-2570058aa879 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:06.861737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f120fd17-bc48-4a02-85b7-2570058aa879 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:06.862446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f120fd17-bc48-4a02-85b7-2570058aa879 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:06.863596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f120fd17-bc48-4a02-85b7-2570058aa879 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:06.864183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f120fd17-bc48-4a02-85b7-2570058aa879 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:06.904684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-c4797544-8292-4767-aa6b-95ef7dcd7fb8 req-39f45a8c-3b34-48bb-a87a-aee0d2019bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2d64fa-31c1-4d92-8770-5dc5259e5bd4", "tag": "ce41e60b-9d99-45cf-af89-099b2059efc1"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:06.906361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 18:01:06.906361 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 18:01:06.913409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-c4797544-8292-4767-aa6b-95ef7dcd7fb8 req-39f45a8c-3b34-48bb-a87a-aee0d2019bdd service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:06.913918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-c4797544-8292-4767-aa6b-95ef7dcd7fb8 req-39f45a8c-3b34-48bb-a87a-aee0d2019bdd service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:06.924587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f120fd17-bc48-4a02-85b7-2570058aa879 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.081328 Nov 08 18:01:06.926666 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1257/2516] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:06 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:01:06.927583 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-c4797544-8292-4767-aa6b-95ef7dcd7fb8 req-39f45a8c-3b34-48bb-a87a-aee0d2019bdd service nova] Creating event network-changed:ce41e60b-9d99-45cf-af89-099b2059efc1 for instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 on hv-cinder-81689 Nov 08 18:01:06.932726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-c4797544-8292-4767-aa6b-95ef7dcd7fb8 req-39f45a8c-3b34-48bb-a87a-aee0d2019bdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087385 Nov 08 18:01:06.933309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1260/2517] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 18:01:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 08 18:01:07.936258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1e7fec8e-614a-4519-a88f-60e1b58f279c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:07.937862 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1e7fec8e-614a-4519-a88f-60e1b58f279c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:07.944771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e7fec8e-614a-4519-a88f-60e1b58f279c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:07.945220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e7fec8e-614a-4519-a88f-60e1b58f279c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:07.947361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e7fec8e-614a-4519-a88f-60e1b58f279c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:07.947361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1e7fec8e-614a-4519-a88f-60e1b58f279c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:08.004767 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1e7fec8e-614a-4519-a88f-60e1b58f279c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.072467 Nov 08 18:01:08.005408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1258/2518] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:07 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:01:09.016598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f7a93fa8-975c-48f3-a1a5-fe8397cb8a96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:09.017508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f7a93fa8-975c-48f3-a1a5-fe8397cb8a96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:09.023638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7a93fa8-975c-48f3-a1a5-fe8397cb8a96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:09.024081 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7a93fa8-975c-48f3-a1a5-fe8397cb8a96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:09.024850 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7a93fa8-975c-48f3-a1a5-fe8397cb8a96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:09.025276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f7a93fa8-975c-48f3-a1a5-fe8397cb8a96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:09.090624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f7a93fa8-975c-48f3-a1a5-fe8397cb8a96 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.078372 Nov 08 18:01:09.091425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1261/2519] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:09 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:01:10.102970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b1abbac3-7d21-44bd-9a4b-80d3769192d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:10.103915 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b1abbac3-7d21-44bd-9a4b-80d3769192d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:10.111315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1abbac3-7d21-44bd-9a4b-80d3769192d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:10.111752 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1abbac3-7d21-44bd-9a4b-80d3769192d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:10.112517 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1abbac3-7d21-44bd-9a4b-80d3769192d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:10.112943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b1abbac3-7d21-44bd-9a4b-80d3769192d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:10.169315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b1abbac3-7d21-44bd-9a4b-80d3769192d5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.070665 Nov 08 18:01:10.170080 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1259/2520] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:10 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:01:11.180786 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-56982a70-618f-407c-9147-de908a1d89c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:11.181788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-56982a70-618f-407c-9147-de908a1d89c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:11.189234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56982a70-618f-407c-9147-de908a1d89c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:11.189674 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56982a70-618f-407c-9147-de908a1d89c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:11.190438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56982a70-618f-407c-9147-de908a1d89c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:11.190891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-56982a70-618f-407c-9147-de908a1d89c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:11.250831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-56982a70-618f-407c-9147-de908a1d89c7 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.073936 Nov 08 18:01:11.251355 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1262/2521] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:11 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:01:12.262583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ee8743e7-179f-438d-8aec-ba9bcf1cde08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:12.263489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ee8743e7-179f-438d-8aec-ba9bcf1cde08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:12.270751 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee8743e7-179f-438d-8aec-ba9bcf1cde08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:12.271195 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee8743e7-179f-438d-8aec-ba9bcf1cde08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:12.271953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee8743e7-179f-438d-8aec-ba9bcf1cde08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:12.272379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee8743e7-179f-438d-8aec-ba9bcf1cde08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:12.329694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ee8743e7-179f-438d-8aec-ba9bcf1cde08 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.071115 Nov 08 18:01:12.330299 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1260/2522] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:12 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:01:13.340939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-71f18e7b-b083-4285-b9ec-9b2195e31d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:13.341930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-71f18e7b-b083-4285-b9ec-9b2195e31d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:13.348873 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71f18e7b-b083-4285-b9ec-9b2195e31d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:13.349315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71f18e7b-b083-4285-b9ec-9b2195e31d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:13.350533 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71f18e7b-b083-4285-b9ec-9b2195e31d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:13.350976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-71f18e7b-b083-4285-b9ec-9b2195e31d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:13.409301 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-71f18e7b-b083-4285-b9ec-9b2195e31d3e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.072622 Nov 08 18:01:13.409888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1263/2523] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:13 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:01:14.420455 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a73383f1-24ee-46d1-b45a-7e8008a79c63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:14.421463 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a73383f1-24ee-46d1-b45a-7e8008a79c63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:14.428392 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a73383f1-24ee-46d1-b45a-7e8008a79c63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:14.428832 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a73383f1-24ee-46d1-b45a-7e8008a79c63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:14.429592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a73383f1-24ee-46d1-b45a-7e8008a79c63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:14.430016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a73383f1-24ee-46d1-b45a-7e8008a79c63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:14.490908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a73383f1-24ee-46d1-b45a-7e8008a79c63 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.074302 Nov 08 18:01:14.491550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1261/2524] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:14 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:01:15.501982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5f99ded9-aa80-413d-ba23-e67507591e7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:15.503002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5f99ded9-aa80-413d-ba23-e67507591e7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:15.509845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5f99ded9-aa80-413d-ba23-e67507591e7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:15.510290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5f99ded9-aa80-413d-ba23-e67507591e7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:15.511156 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5f99ded9-aa80-413d-ba23-e67507591e7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:15.511589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5f99ded9-aa80-413d-ba23-e67507591e7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:15.568809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5f99ded9-aa80-413d-ba23-e67507591e7a tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 14 microversion: 2.20 time: 0.070849 Nov 08 18:01:15.569394 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1264/2525] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:15 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:01:16.580199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5213c369-5945-4533-9f24-8b3a6f10edc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:16.581183 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5213c369-5945-4533-9f24-8b3a6f10edc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:16.587928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5213c369-5945-4533-9f24-8b3a6f10edc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:16.588372 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5213c369-5945-4533-9f24-8b3a6f10edc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:16.589135 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5213c369-5945-4533-9f24-8b3a6f10edc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:16.589567 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5213c369-5945-4533-9f24-8b3a6f10edc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:16.659929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5213c369-5945-4533-9f24-8b3a6f10edc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 4153 microversion: 2.20 time: 0.083665 Nov 08 18:01:16.660566 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1262/2526] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:16 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 4153 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:01:17.673316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-478e7e25-52af-4e2a-b9bb-ac2e79dc892e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:17.674442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-478e7e25-52af-4e2a-b9bb-ac2e79dc892e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:17.682504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-478e7e25-52af-4e2a-b9bb-ac2e79dc892e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:17.682955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-478e7e25-52af-4e2a-b9bb-ac2e79dc892e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:17.683720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-478e7e25-52af-4e2a-b9bb-ac2e79dc892e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:17.685234 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-478e7e25-52af-4e2a-b9bb-ac2e79dc892e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:17.767504 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-478e7e25-52af-4e2a-b9bb-ac2e79dc892e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 15025 microversion: 2.20 time: 0.099787 Nov 08 18:01:17.768316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1265/2527] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:17 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 15025 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:18.780808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f1ff60a8-5111-4bef-92e3-a669c4d88cc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:18.781803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f1ff60a8-5111-4bef-92e3-a669c4d88cc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:18.788650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1ff60a8-5111-4bef-92e3-a669c4d88cc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:18.789096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1ff60a8-5111-4bef-92e3-a669c4d88cc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:18.789863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1ff60a8-5111-4bef-92e3-a669c4d88cc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:18.790294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f1ff60a8-5111-4bef-92e3-a669c4d88cc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:18.857632 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f1ff60a8-5111-4bef-92e3-a669c4d88cc5 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 18561 microversion: 2.20 time: 0.081259 Nov 08 18:01:18.858415 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1263/2528] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:18 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 18561 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:19.869716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5e6c9985-7937-4802-b957-8b3abdaa8c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:19.870831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5e6c9985-7937-4802-b957-8b3abdaa8c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:19.878493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5e6c9985-7937-4802-b957-8b3abdaa8c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:19.878938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5e6c9985-7937-4802-b957-8b3abdaa8c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:19.879714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5e6c9985-7937-4802-b957-8b3abdaa8c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:19.880148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5e6c9985-7937-4802-b957-8b3abdaa8c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:19.956309 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5e6c9985-7937-4802-b957-8b3abdaa8c33 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 19841 microversion: 2.20 time: 0.090445 Nov 08 18:01:19.956954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1266/2529] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:19 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 19841 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:20.968612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-08ee8c9c-b90f-4910-be93-e7cc68443820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:20.969607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-08ee8c9c-b90f-4910-be93-e7cc68443820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:20.976595 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08ee8c9c-b90f-4910-be93-e7cc68443820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:20.977035 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08ee8c9c-b90f-4910-be93-e7cc68443820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:20.977796 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08ee8c9c-b90f-4910-be93-e7cc68443820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:20.978222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08ee8c9c-b90f-4910-be93-e7cc68443820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:21.051055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-08ee8c9c-b90f-4910-be93-e7cc68443820 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 22546 microversion: 2.20 time: 0.086478 Nov 08 18:01:21.051696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1264/2530] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:20 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 22546 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:01:22.063908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8b33c5f9-a6a1-45e3-a549-eae7af0cc2aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:22.064978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8b33c5f9-a6a1-45e3-a549-eae7af0cc2aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:22.071898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b33c5f9-a6a1-45e3-a549-eae7af0cc2aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:22.072352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b33c5f9-a6a1-45e3-a549-eae7af0cc2aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:22.073121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b33c5f9-a6a1-45e3-a549-eae7af0cc2aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:22.073550 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8b33c5f9-a6a1-45e3-a549-eae7af0cc2aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:22.146452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8b33c5f9-a6a1-45e3-a549-eae7af0cc2aa tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 23801 microversion: 2.20 time: 0.087213 Nov 08 18:01:22.147108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1267/2531] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:22 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 23801 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:23.157933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0d83ecae-f1a0-4083-b69a-d24f2fc86100 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:23.158956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0d83ecae-f1a0-4083-b69a-d24f2fc86100 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:23.165791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d83ecae-f1a0-4083-b69a-d24f2fc86100 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:23.166229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d83ecae-f1a0-4083-b69a-d24f2fc86100 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:23.167033 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d83ecae-f1a0-4083-b69a-d24f2fc86100 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:23.167482 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d83ecae-f1a0-4083-b69a-d24f2fc86100 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:23.237648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0d83ecae-f1a0-4083-b69a-d24f2fc86100 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 25550 microversion: 2.20 time: 0.083967 Nov 08 18:01:23.238509 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1265/2532] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:23 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 25550 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:24.249569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-847db259-254a-45d8-a75b-93e6e4f88bbf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:24.250584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-847db259-254a-45d8-a75b-93e6e4f88bbf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:24.257445 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-847db259-254a-45d8-a75b-93e6e4f88bbf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:24.257886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-847db259-254a-45d8-a75b-93e6e4f88bbf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:24.258677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-847db259-254a-45d8-a75b-93e6e4f88bbf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:24.259108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-847db259-254a-45d8-a75b-93e6e4f88bbf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:24.331940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-847db259-254a-45d8-a75b-93e6e4f88bbf tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 26979 microversion: 2.20 time: 0.086331 Nov 08 18:01:24.332544 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1268/2533] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:24 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 26979 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:25.344235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a86da836-bfc2-42ce-8009-38630d827315 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:25.345668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a86da836-bfc2-42ce-8009-38630d827315 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:25.352682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a86da836-bfc2-42ce-8009-38630d827315 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:25.353116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a86da836-bfc2-42ce-8009-38630d827315 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:25.353872 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a86da836-bfc2-42ce-8009-38630d827315 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:25.354297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a86da836-bfc2-42ce-8009-38630d827315 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:25.440789 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a86da836-bfc2-42ce-8009-38630d827315 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 27769 microversion: 2.20 time: 0.100535 Nov 08 18:01:25.441453 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1266/2534] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:25 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 27769 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:01:26.452726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e9be59c6-0d90-477e-821e-acd4b6aefe5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:26.453711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e9be59c6-0d90-477e-821e-acd4b6aefe5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:26.460584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e9be59c6-0d90-477e-821e-acd4b6aefe5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:26.461021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e9be59c6-0d90-477e-821e-acd4b6aefe5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:26.461778 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e9be59c6-0d90-477e-821e-acd4b6aefe5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:26.462233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e9be59c6-0d90-477e-821e-acd4b6aefe5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:26.535515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e9be59c6-0d90-477e-821e-acd4b6aefe5d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 28240 microversion: 2.20 time: 0.086689 Nov 08 18:01:26.536130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1269/2535] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:26 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 28240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:27.547545 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a6e22ab9-1eff-4338-ad70-b41832880500 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:27.548527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a6e22ab9-1eff-4338-ad70-b41832880500 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:27.555312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6e22ab9-1eff-4338-ad70-b41832880500 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:27.555757 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6e22ab9-1eff-4338-ad70-b41832880500 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:27.556541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6e22ab9-1eff-4338-ad70-b41832880500 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:27.556966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6e22ab9-1eff-4338-ad70-b41832880500 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:27.617798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a6e22ab9-1eff-4338-ad70-b41832880500 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 28240 microversion: 2.20 time: 0.074208 Nov 08 18:01:27.618421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1267/2536] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:27 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 28240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:28.630062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9cc73d44-a0f6-4ccc-9cd3-f54847e99b79 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:28.631083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9cc73d44-a0f6-4ccc-9cd3-f54847e99b79 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:28.638097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9cc73d44-a0f6-4ccc-9cd3-f54847e99b79 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:28.638570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9cc73d44-a0f6-4ccc-9cd3-f54847e99b79 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:28.639335 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9cc73d44-a0f6-4ccc-9cd3-f54847e99b79 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:28.639768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9cc73d44-a0f6-4ccc-9cd3-f54847e99b79 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:28.716111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9cc73d44-a0f6-4ccc-9cd3-f54847e99b79 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 28531 microversion: 2.20 time: 0.090139 Nov 08 18:01:28.716736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1270/2537] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:28 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 28531 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:29.729317 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8fee155d-8384-4969-9e4d-bda22d5dbcc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:29.730714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8fee155d-8384-4969-9e4d-bda22d5dbcc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:29.738302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fee155d-8384-4969-9e4d-bda22d5dbcc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:29.738873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fee155d-8384-4969-9e4d-bda22d5dbcc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:29.739651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fee155d-8384-4969-9e4d-bda22d5dbcc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:29.740210 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8fee155d-8384-4969-9e4d-bda22d5dbcc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:29.824644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8fee155d-8384-4969-9e4d-bda22d5dbcc9 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 28699 microversion: 2.20 time: 0.099495 Nov 08 18:01:29.825298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1268/2538] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:29 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 28699 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:30.836694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4576a85d-c27f-44ef-af55-19b798d2f48c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:30.837711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4576a85d-c27f-44ef-af55-19b798d2f48c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:30.845129 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4576a85d-c27f-44ef-af55-19b798d2f48c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:30.845575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4576a85d-c27f-44ef-af55-19b798d2f48c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:30.846337 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4576a85d-c27f-44ef-af55-19b798d2f48c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:30.846792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4576a85d-c27f-44ef-af55-19b798d2f48c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:30.910628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4576a85d-c27f-44ef-af55-19b798d2f48c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 28699 microversion: 2.20 time: 0.077783 Nov 08 18:01:30.911260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1271/2539] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:30 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 28699 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:31.922430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4cc4d653-0587-461c-8bd0-8df0f5f867b2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:31.923518 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-4cc4d653-0587-461c-8bd0-8df0f5f867b2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:31.930617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4cc4d653-0587-461c-8bd0-8df0f5f867b2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:31.931060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4cc4d653-0587-461c-8bd0-8df0f5f867b2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:31.931823 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4cc4d653-0587-461c-8bd0-8df0f5f867b2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:31.932252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-4cc4d653-0587-461c-8bd0-8df0f5f867b2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:31.999208 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4cc4d653-0587-461c-8bd0-8df0f5f867b2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 28699 microversion: 2.20 time: 0.080624 Nov 08 18:01:32.000398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1269/2540] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:31 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 28699 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:01:33.011898 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e174d5d1-657b-4eba-9bda-b81ffd0a4d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:33.012882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e174d5d1-657b-4eba-9bda-b81ffd0a4d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:33.019802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e174d5d1-657b-4eba-9bda-b81ffd0a4d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:33.020244 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e174d5d1-657b-4eba-9bda-b81ffd0a4d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:33.020999 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e174d5d1-657b-4eba-9bda-b81ffd0a4d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:33.021432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e174d5d1-657b-4eba-9bda-b81ffd0a4d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:33.095977 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e174d5d1-657b-4eba-9bda-b81ffd0a4d6b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 29421 microversion: 2.20 time: 0.087926 Nov 08 18:01:33.096596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1272/2541] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:33 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 29421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:34.107501 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a6760746-85ec-4b00-a074-745a5637b1fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:34.108488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a6760746-85ec-4b00-a074-745a5637b1fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:34.115672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6760746-85ec-4b00-a074-745a5637b1fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:34.118328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6760746-85ec-4b00-a074-745a5637b1fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:34.118328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6760746-85ec-4b00-a074-745a5637b1fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:34.118328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a6760746-85ec-4b00-a074-745a5637b1fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:34.192905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a6760746-85ec-4b00-a074-745a5637b1fb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 31619 microversion: 2.20 time: 0.089297 Nov 08 18:01:34.193548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1270/2542] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:34 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 31619 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:01:35.205640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-056689f0-1456-45e9-9d46-18777973d65e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:35.206662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-056689f0-1456-45e9-9d46-18777973d65e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:35.213442 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-056689f0-1456-45e9-9d46-18777973d65e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:35.213896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-056689f0-1456-45e9-9d46-18777973d65e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:35.214699 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-056689f0-1456-45e9-9d46-18777973d65e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:35.215137 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-056689f0-1456-45e9-9d46-18777973d65e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:35.288217 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-056689f0-1456-45e9-9d46-18777973d65e tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 33299 microversion: 2.20 time: 0.087064 Nov 08 18:01:35.288780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1273/2543] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:35 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 33299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:36.300860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ac4ad16d-58dd-4fb2-b953-9f33c0a09b82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:36.301953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ac4ad16d-58dd-4fb2-b953-9f33c0a09b82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:36.308766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ac4ad16d-58dd-4fb2-b953-9f33c0a09b82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:36.309205 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ac4ad16d-58dd-4fb2-b953-9f33c0a09b82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:36.309959 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ac4ad16d-58dd-4fb2-b953-9f33c0a09b82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:36.310385 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ac4ad16d-58dd-4fb2-b953-9f33c0a09b82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:36.381792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ac4ad16d-58dd-4fb2-b953-9f33c0a09b82 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 34277 microversion: 2.20 time: 0.085014 Nov 08 18:01:36.382412 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1271/2544] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:36 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 34277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:01:37.393880 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e045d185-0d4e-4ce5-9f40-595cff46859f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:37.394909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e045d185-0d4e-4ce5-9f40-595cff46859f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:37.401808 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e045d185-0d4e-4ce5-9f40-595cff46859f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:37.402257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e045d185-0d4e-4ce5-9f40-595cff46859f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:37.403056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e045d185-0d4e-4ce5-9f40-595cff46859f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:37.403492 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e045d185-0d4e-4ce5-9f40-595cff46859f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:37.476092 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e045d185-0d4e-4ce5-9f40-595cff46859f tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 35433 microversion: 2.20 time: 0.086081 Nov 08 18:01:37.476972 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1274/2545] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:37 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 35433 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:38.488315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-41e6c275-655b-4183-a2a4-65b15556bcab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:38.489308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-41e6c275-655b-4183-a2a4-65b15556bcab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:38.496082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41e6c275-655b-4183-a2a4-65b15556bcab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:38.496526 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41e6c275-655b-4183-a2a4-65b15556bcab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:38.497285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41e6c275-655b-4183-a2a4-65b15556bcab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:38.497723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-41e6c275-655b-4183-a2a4-65b15556bcab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:38.569261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-41e6c275-655b-4183-a2a4-65b15556bcab tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 36867 microversion: 2.20 time: 0.084992 Nov 08 18:01:38.569885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1272/2546] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:38 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 36867 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:39.581647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a230c476-127f-4873-86e0-f6ec9bccf734 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:39.582663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a230c476-127f-4873-86e0-f6ec9bccf734 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:39.589446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a230c476-127f-4873-86e0-f6ec9bccf734 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:39.589891 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a230c476-127f-4873-86e0-f6ec9bccf734 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:39.590691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a230c476-127f-4873-86e0-f6ec9bccf734 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:39.591127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a230c476-127f-4873-86e0-f6ec9bccf734 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:39.665596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a230c476-127f-4873-86e0-f6ec9bccf734 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 38258 microversion: 2.20 time: 0.088032 Nov 08 18:01:39.666206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1275/2547] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:39 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 38258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:40.678212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0764967e-b591-4df1-b0c0-ad813899b2a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:40.679238 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0764967e-b591-4df1-b0c0-ad813899b2a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:40.685956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0764967e-b591-4df1-b0c0-ad813899b2a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:40.686395 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0764967e-b591-4df1-b0c0-ad813899b2a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:40.687175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0764967e-b591-4df1-b0c0-ad813899b2a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:40.687600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0764967e-b591-4df1-b0c0-ad813899b2a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:40.763652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0764967e-b591-4df1-b0c0-ad813899b2a2 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 38258 microversion: 2.20 time: 0.089363 Nov 08 18:01:40.764282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1273/2548] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:40 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 38258 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:01:41.776043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d3bab97a-42fb-4bac-9f0a-07ca71418839 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:41.777046 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d3bab97a-42fb-4bac-9f0a-07ca71418839 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:41.784152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d3bab97a-42fb-4bac-9f0a-07ca71418839 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:41.784598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d3bab97a-42fb-4bac-9f0a-07ca71418839 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:41.785368 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d3bab97a-42fb-4bac-9f0a-07ca71418839 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:41.785805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d3bab97a-42fb-4bac-9f0a-07ca71418839 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:41.845086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d3bab97a-42fb-4bac-9f0a-07ca71418839 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 38258 microversion: 2.20 time: 0.072971 Nov 08 18:01:41.845696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1276/2549] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:41 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 38258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:01:42.857293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-67db5195-e730-47df-8e7c-f6e990c1b42b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:42.858277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-67db5195-e730-47df-8e7c-f6e990c1b42b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:42.865800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67db5195-e730-47df-8e7c-f6e990c1b42b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:42.866270 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67db5195-e730-47df-8e7c-f6e990c1b42b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:42.867068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67db5195-e730-47df-8e7c-f6e990c1b42b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:42.867503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-67db5195-e730-47df-8e7c-f6e990c1b42b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:42.930960 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-67db5195-e730-47df-8e7c-f6e990c1b42b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 38258 microversion: 2.20 time: 0.077598 Nov 08 18:01:42.931610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1274/2550] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:42 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 38258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:01:43.943760 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-866acd15-eedc-4279-b4b0-119f6d38a010 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:01:43.944746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-866acd15-eedc-4279-b4b0-119f6d38a010 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:43.951524 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-866acd15-eedc-4279-b4b0-119f6d38a010 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:43.951995 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-866acd15-eedc-4279-b4b0-119f6d38a010 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:43.952758 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-866acd15-eedc-4279-b4b0-119f6d38a010 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:43.953186 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-866acd15-eedc-4279-b4b0-119f6d38a010 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:44.024375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-866acd15-eedc-4279-b4b0-119f6d38a010 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action" status: 200 len: 38401 microversion: 2.20 time: 0.084534 Nov 08 18:01:44.025409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1277/2551] 10.222.0.18 () {62 vars in 1318 bytes} [Mon Nov 8 18:01:43 2021] POST /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/action => generated 38401 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 08 18:01:44.035367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a5a4458e-1bd6-45f0-a73b-f64deea3eb86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:01:44.035929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a5a4458e-1bd6-45f0-a73b-f64deea3eb86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:01:44.042749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a5a4458e-1bd6-45f0-a73b-f64deea3eb86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:44.043202 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a5a4458e-1bd6-45f0-a73b-f64deea3eb86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:44.043964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a5a4458e-1bd6-45f0-a73b-f64deea3eb86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:01:44.044400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a5a4458e-1bd6-45f0-a73b-f64deea3eb86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:01:44.067497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a5a4458e-1bd6-45f0-a73b-f64deea3eb86 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/ips" status: 200 len: 152 microversion: 2.20 time: 0.036267 Nov 08 18:01:44.068072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1275/2552] 10.222.0.18 () {60 vars in 1288 bytes} [Mon Nov 8 18:01:44 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 08 18:02:44.140981 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-42bd2d38-8707-4f2d-b379-e5ba2bf2b58c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:44.141576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-42bd2d38-8707-4f2d-b379-e5ba2bf2b58c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:02:44.149188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42bd2d38-8707-4f2d-b379-e5ba2bf2b58c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:44.149638 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42bd2d38-8707-4f2d-b379-e5ba2bf2b58c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:44.150406 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42bd2d38-8707-4f2d-b379-e5ba2bf2b58c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:44.150881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42bd2d38-8707-4f2d-b379-e5ba2bf2b58c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:44.175084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-42bd2d38-8707-4f2d-b379-e5ba2bf2b58c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 18:02:44.441237 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-42bd2d38-8707-4f2d-b379-e5ba2bf2b58c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 204 len: 0 microversion: 2.20 time: 0.304947 Nov 08 18:02:44.441816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1278/2553] 10.222.0.18 () {60 vars in 1279 bytes} [Mon Nov 8 18:02:44 2021] DELETE /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 08 18:02:44.450811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:44.451418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:02:44.457279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:44.458217 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:44.459007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:44.459435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:44.589264 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:44.596812 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:44.598295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:44.599714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-69863496-94c4-4925-b1f7-03b168a4a223 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1724 microversion: 2.20 time: 0.153559 Nov 08 18:02:44.600266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1276/2554] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:02:44 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:02:45.618541 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:45.619230 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:02:45.626103 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:45.626569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:45.627334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:45.627766 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:45.758580 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:45.766293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:45.767852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:45.768994 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-63fd9fce-0553-41e0-82a8-4befce58f177 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1724 microversion: 2.20 time: 0.154525 Nov 08 18:02:45.769678 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1279/2555] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:02:45 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:02:46.788258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:46.788926 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:02:46.795137 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:46.795583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:46.796357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:46.796788 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:46.857790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:46.866283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:46.867790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:46.868951 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-95b65cfe-422b-45bb-aea3-6bf8672200eb tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1656 microversion: 2.20 time: 0.085038 Nov 08 18:02:46.869534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1277/2556] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:02:46 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 08 18:02:46.965298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-2cb3b209-cb23-4636-9889-99ab5682d6b4 req-562b7bd6-f2c0-45ac-8b41-33ddbc484da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2d64fa-31c1-4d92-8770-5dc5259e5bd4", "name": "network-vif-deleted", "tag": "ce41e60b-9d99-45cf-af89-099b2059efc1"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:02:46.966903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 18:02:46.966903 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 18:02:46.975312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-2cb3b209-cb23-4636-9889-99ab5682d6b4 req-562b7bd6-f2c0-45ac-8b41-33ddbc484da2 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:46.975885 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-2cb3b209-cb23-4636-9889-99ab5682d6b4 req-562b7bd6-f2c0-45ac-8b41-33ddbc484da2 service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:46.987225 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-2cb3b209-cb23-4636-9889-99ab5682d6b4 req-562b7bd6-f2c0-45ac-8b41-33ddbc484da2 service nova] Creating event network-vif-deleted:ce41e60b-9d99-45cf-af89-099b2059efc1 for instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 on hv-cinder-81689 Nov 08 18:02:46.993145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-2cb3b209-cb23-4636-9889-99ab5682d6b4 req-562b7bd6-f2c0-45ac-8b41-33ddbc484da2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031382 Nov 08 18:02:46.993822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1280/2557] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 18:02:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:02:47.886805 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:47.887544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:02:47.894155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:47.894760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:47.895868 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:47.896859 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:47.928193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:47.928551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:47.928995 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lazy-loading 'fault' on Instance uuid 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 18:02:47.969328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:47.977332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:47.978834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd88ffa0544a14579bf1e045e795d551a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7801fb7e4cdc48f7af389d704485ca15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:02:47.979986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-db19e9af-a7b4-434d-99b0-ec87fc3d056d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 200 len: 1371 microversion: 2.20 time: 0.097008 Nov 08 18:02:47.980555 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1278/2558] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:02:47 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 08 18:02:48.999779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:49.000618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:02:49.007625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:49.008080 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:49.008854 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:49.009287 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:49.022733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] HTTP exception thrown: Instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 could not be found. Nov 08 18:02:49.023316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Returning 404 to user: Instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:02:49.024128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a72738c8-678e-451b-b935-9c9a33a7a300 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 404 len: 111 microversion: 2.20 time: 0.028864 Nov 08 18:02:49.024654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1281/2559] 10.222.0.18 () {60 vars in 1276 bytes} [Mon Nov 8 18:02:48 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 08 18:02:49.032608 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d775bad7-31aa-4fb2-a551-41bd8e9eba4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '.version_select at 0x7f06ec1a7700>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:49.110931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d775bad7-31aa-4fb2-a551-41bd8e9eba4c tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888763827" status: 204 len: 0 microversion: 2.20 time: 0.081805 Nov 08 18:02:49.111499 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1279/2560] 10.222.0.18 () {60 vars in 1258 bytes} [Mon Nov 8 18:02:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888763827 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 08 18:02:49.863764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:49.864253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:02:49.874135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:49.874602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:49.875375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:49.875796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:49.889280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] HTTP exception thrown: Instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 could not be found. Nov 08 18:02:49.889851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Returning 404 to user: Instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:02:49.890682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e5d2e518-b09b-4d3d-947a-fd06b33e542d tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 404 len: 111 microversion: 2.1 time: 0.030657 Nov 08 18:02:49.891197 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1282/2561] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 18:02:49 2021] DELETE /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 18:02:49.899645 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:02:49.900329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:02:49.906198 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:49.906689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:49.907454 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:02:49.907886 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:02:49.920754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] HTTP exception thrown: Instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 could not be found. Nov 08 18:02:49.921334 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Returning 404 to user: Instance 7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:02:49.922282 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-be65125e-9d86-42d1-b7ec-5bfef8353901 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4" status: 404 len: 111 microversion: 2.1 time: 0.026990 Nov 08 18:02:49.922841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1280/2562] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:02:49 2021] GET /compute/v2.1/servers/7f2d64fa-31c1-4d92-8770-5dc5259e5bd4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 18:03:10.839922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:03:10.840468 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:03:10.848399 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:03:10.856227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:03:10.856227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:03:10.856227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:03:10.868281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] HTTP exception thrown: Instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 could not be found. Nov 08 18:03:10.868894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Returning 404 to user: Instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:03:10.869730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-46df4c09-91aa-4e17-b904-95c7f6e2b51a tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 404 len: 111 microversion: 2.1 time: 0.034315 Nov 08 18:03:10.871124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1283/2563] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 18:03:10 2021] DELETE /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 18:03:10.879579 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:03:10.880178 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] [instance: cabb9c79-5e8d-4982-a6eb-4169e2471b27] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:03:10.887860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:03:10.888310 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:03:10.889082 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:03:10.889525 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:03:10.903575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] HTTP exception thrown: Instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 could not be found. Nov 08 18:03:10.904177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] Returning 404 to user: Instance cabb9c79-5e8d-4982-a6eb-4169e2471b27 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:03:10.905274 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5f926a3c-1532-4b42-ab13-c34c3b70744b tempest-AttachVolumeTestJSON-128851661 tempest-AttachVolumeTestJSON-128851661-project] 10.222.0.18 "GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27" status: 404 len: 111 microversion: 2.1 time: 0.029147 Nov 08 18:03:10.905588 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1281/2564] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:03:10 2021] GET /compute/v2.1/servers/cabb9c79-5e8d-4982-a6eb-4169e2471b27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 08 18:03:49.545572 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:03:49.546176 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:03:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:03:50.512976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:03:50.513488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:03:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:03:55.097090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:03:55.097505 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:03:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:04:26.007009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:04:26.007530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:04:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:04:52.316737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:04:52.317405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:04:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:05:56.404145 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:05:56.404722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:05:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:07:09.563215 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:07:09.563862 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:07:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:07:10.529543 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:07:10.530057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:07:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:07:15.115343 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:07:15.115819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:07:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:07:46.025258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:07:46.025740 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:07:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:08:12.333966 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:08:12.334658 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:08:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:08:55.457161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3ffaa8fd-e4fd-4972-bee0-755ece7c68e0] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 08 18:08:55.460677 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:08:55.462251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:08:55.466987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:08:55.467421 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:08:55.468177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:08:55.468607 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:08:55.482543 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] HTTP exception thrown: Instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 could not be found. Nov 08 18:08:55.483133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Returning 404 to user: Instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:08:55.483945 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3e6d5f70-37c3-405c-b638-45b193533014 tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 404 len: 111 microversion: 2.1 time: 0.029845 Nov 08 18:08:55.484465 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1284/2565] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 18:08:55 2021] DELETE /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 18:08:55.493243 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3774545c-b517-444a-b51c-8a639ea5b12f] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 08 18:08:55.496495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:08:55.497129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] [instance: cf21b3ca-51f1-43c5-9b61-78422c205ff1] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:08:55.503003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:08:55.503449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:08:55.504209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:08:55.504643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:08:55.517535 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.wsgi [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] HTTP exception thrown: Instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 could not be found. Nov 08 18:08:55.518110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] Returning 404 to user: Instance cf21b3ca-51f1-43c5-9b61-78422c205ff1 could not be found. {{(pid=127763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:08:55.518943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d18ec329-cd39-44d6-9572-3a5954c99c0b tempest-AttachVolumeShelveTestJSON-190559044 tempest-AttachVolumeShelveTestJSON-190559044-project] 10.222.0.18 "GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1" status: 404 len: 111 microversion: 2.1 time: 0.027706 Nov 08 18:08:55.519459 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1282/2566] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:08:55 2021] GET /compute/v2.1/servers/cf21b3ca-51f1-43c5-9b61-78422c205ff1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 18:09:11.427809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:11.428297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:11.445193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:11.445645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:11.446412 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:11.446940 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:11.452590 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] [3ffaa8fd-e4fd-4972-bee0-755ece7c68e0] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59662. Nov 08 18:09:11.475835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Going to try to terminate instance {{(pid=127762) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 18:09:11.677725 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [8b8a761b-b175-42bc-b483-2d3f163b9e19] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 08 18:09:11.742042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8f4defe9-6f02-4194-8b9d-50af686d6f83 tempest-TestVolumeBootPattern-1590194854 tempest-TestVolumeBootPattern-1590194854-project] Calling method '.version_select at 0x7f06ec26e310>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:11.765367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] [3774545c-b517-444a-b51c-8a639ea5b12f] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59674. Nov 08 18:09:11.847537 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8f4defe9-6f02-4194-8b9d-50af686d6f83 tempest-TestVolumeBootPattern-1590194854 tempest-TestVolumeBootPattern-1590194854-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2130527841" status: 202 len: 0 microversion: 2.1 time: 0.109264 Nov 08 18:09:11.848168 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1283/2567] 10.222.0.18 () {58 vars in 1262 bytes} [Mon Nov 8 18:09:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2130527841 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 08 18:09:12.694256 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [8b8a761b-b175-42bc-b483-2d3f163b9e19] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 59686. Nov 08 18:09:12.800149 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bb9cec52-b85c-4941-9f0c-6b48a7e13ed4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 204 len: 0 microversion: 2.1 time: 1.376391 Nov 08 18:09:12.800755 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1285/2568] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 18:09:11 2021] DELETE /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 0 bytes in 1378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 18:09:12.809301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-285449e0-dcdf-407c-b983-0e1e90a7d2df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:12.809909 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-285449e0-dcdf-407c-b983-0e1e90a7d2df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:12.817308 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-285449e0-dcdf-407c-b983-0e1e90a7d2df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:12.817760 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-285449e0-dcdf-407c-b983-0e1e90a7d2df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:12.818572 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-285449e0-dcdf-407c-b983-0e1e90a7d2df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:12.819008 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-285449e0-dcdf-407c-b983-0e1e90a7d2df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:13.204976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-285449e0-dcdf-407c-b983-0e1e90a7d2df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:13.212785 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-285449e0-dcdf-407c-b983-0e1e90a7d2df tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1509 microversion: 2.1 time: 0.407665 Nov 08 18:09:13.213357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1284/2569] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:12 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1509 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:13.989130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-7ac1b0ef-e42f-4dbb-b01a-e2788c0a173a req-3b572d61-80e5-40a3-a2f0-e25dc3a924bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ac9249-632c-47a0-9e4d-c755389099b6", "name": "network-vif-deleted", "tag": "11f15d53-0cdb-4385-a9ee-9c72b5c78f2a"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:09:13.990826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 18:09:13.990826 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 18:09:14.008041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-7ac1b0ef-e42f-4dbb-b01a-e2788c0a173a req-3b572d61-80e5-40a3-a2f0-e25dc3a924bb service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:14.008665 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-7ac1b0ef-e42f-4dbb-b01a-e2788c0a173a req-3b572d61-80e5-40a3-a2f0-e25dc3a924bb service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:14.020060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-7ac1b0ef-e42f-4dbb-b01a-e2788c0a173a req-3b572d61-80e5-40a3-a2f0-e25dc3a924bb service nova] Creating event network-vif-deleted:11f15d53-0cdb-4385-a9ee-9c72b5c78f2a for instance a5ac9249-632c-47a0-9e4d-c755389099b6 on hv-cinder-81689 Nov 08 18:09:14.028953 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-7ac1b0ef-e42f-4dbb-b01a-e2788c0a173a req-3b572d61-80e5-40a3-a2f0-e25dc3a924bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120107 Nov 08 18:09:14.029359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1286/2570] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 18:09:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:09:14.236249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:14.237057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:14.243650 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:14.244400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:14.245179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:14.245611 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:14.280538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:14.280992 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:14.281447 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lazy-loading 'fault' on Instance uuid a5ac9249-632c-47a0-9e4d-c755389099b6 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 18:09:14.524755 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:14.535068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7d3ecee3-864a-4e79-a5c9-54e76df603fe tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 200 len: 1312 microversion: 2.1 time: 0.302478 Nov 08 18:09:14.543561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1285/2571] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:14 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 1312 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:15.554274 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:15.554986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: a5ac9249-632c-47a0-9e4d-c755389099b6] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:15.562435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:15.562906 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:15.563694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:15.564127 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:15.578425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] HTTP exception thrown: Instance a5ac9249-632c-47a0-9e4d-c755389099b6 could not be found. Nov 08 18:09:15.579037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Returning 404 to user: Instance a5ac9249-632c-47a0-9e4d-c755389099b6 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:09:15.579927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-477c8fa7-5dbe-4f42-b0bd-fc8f4e17f47f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6" status: 404 len: 111 microversion: 2.1 time: 0.031373 Nov 08 18:09:15.581321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1287/2572] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:15 2021] GET /compute/v2.1/servers/a5ac9249-632c-47a0-9e4d-c755389099b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 18:09:15.589943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8ccc1975-5215-44d1-ad26-bf406bc3b424 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:15.591104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8ccc1975-5215-44d1-ad26-bf406bc3b424 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:15.598303 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ccc1975-5215-44d1-ad26-bf406bc3b424 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:15.598839 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ccc1975-5215-44d1-ad26-bf406bc3b424 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:15.603500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ccc1975-5215-44d1-ad26-bf406bc3b424 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:15.603500 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ccc1975-5215-44d1-ad26-bf406bc3b424 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:15.633821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8ccc1975-5215-44d1-ad26-bf406bc3b424 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Going to try to terminate instance {{(pid=127763) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 08 18:09:15.972436 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8ccc1975-5215-44d1-ad26-bf406bc3b424 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "DELETE /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 204 len: 0 microversion: 2.1 time: 0.386004 Nov 08 18:09:15.972963 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1286/2573] 10.222.0.18 () {58 vars in 1238 bytes} [Mon Nov 8 18:09:15 2021] DELETE /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 08 18:09:15.980838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-681f712a-133d-4a59-a932-bab1aded26ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:15.981451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-681f712a-133d-4a59-a932-bab1aded26ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:15.988079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-681f712a-133d-4a59-a932-bab1aded26ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:15.989818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-681f712a-133d-4a59-a932-bab1aded26ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:15.990193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-681f712a-133d-4a59-a932-bab1aded26ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:15.990668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-681f712a-133d-4a59-a932-bab1aded26ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:16.292221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-681f712a-133d-4a59-a932-bab1aded26ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:16.300701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-681f712a-133d-4a59-a932-bab1aded26ec tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1569 microversion: 2.1 time: 0.323604 Nov 08 18:09:16.301353 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1288/2574] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1569 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:17.138054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [req-cee7263b-a00f-4d2b-aab6-aa7b200bd4b6 req-d18e50d9-3051-40ac-aa07-e590a180584c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76806517-5f8b-4d47-89f6-66e876baa194", "name": "network-vif-deleted", "tag": "cbf8986a-13eb-4518-a955-17c318486219"}]} {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:09:17.142524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 18:09:17.142524 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: warnings.warn(msg) Nov 08 18:09:17.151767 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-cee7263b-a00f-4d2b-aab6-aa7b200bd4b6 req-d18e50d9-3051-40ac-aa07-e590a180584c service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:17.152251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [req-cee7263b-a00f-4d2b-aab6-aa7b200bd4b6 req-d18e50d9-3051-40ac-aa07-e590a180584c service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:17.163828 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.compute.server_external_events [req-cee7263b-a00f-4d2b-aab6-aa7b200bd4b6 req-d18e50d9-3051-40ac-aa07-e590a180584c service nova] Creating event network-vif-deleted:cbf8986a-13eb-4518-a955-17c318486219 for instance 76806517-5f8b-4d47-89f6-66e876baa194 on hv-cinder-81689 Nov 08 18:09:17.169477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [req-cee7263b-a00f-4d2b-aab6-aa7b200bd4b6 req-d18e50d9-3051-40ac-aa07-e590a180584c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035286 Nov 08 18:09:17.170410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1287/2575] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 18:09:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:09:17.318664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e5d72333-6698-4141-94ae-87d4792da84e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:17.319375 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e5d72333-6698-4141-94ae-87d4792da84e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:17.326700 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d72333-6698-4141-94ae-87d4792da84e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:17.327251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d72333-6698-4141-94ae-87d4792da84e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:17.328118 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d72333-6698-4141-94ae-87d4792da84e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:17.328649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e5d72333-6698-4141-94ae-87d4792da84e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:17.411971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e5d72333-6698-4141-94ae-87d4792da84e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:17.419812 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e5d72333-6698-4141-94ae-87d4792da84e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.106648 Nov 08 18:09:17.420371 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1289/2576] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:18.438890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7eb59288-4683-4de7-b36d-7365764c171e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:18.440181 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7eb59288-4683-4de7-b36d-7365764c171e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:18.446781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7eb59288-4683-4de7-b36d-7365764c171e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:18.447235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7eb59288-4683-4de7-b36d-7365764c171e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:18.448009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7eb59288-4683-4de7-b36d-7365764c171e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:18.448437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7eb59288-4683-4de7-b36d-7365764c171e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:18.514917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7eb59288-4683-4de7-b36d-7365764c171e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:18.523383 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7eb59288-4683-4de7-b36d-7365764c171e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.089038 Nov 08 18:09:18.524171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1288/2577] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:09:19.541097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-86831ca5-98cb-4424-a897-b3dd8b1a302f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:19.541955 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-86831ca5-98cb-4424-a897-b3dd8b1a302f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:19.548769 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86831ca5-98cb-4424-a897-b3dd8b1a302f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:19.549814 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86831ca5-98cb-4424-a897-b3dd8b1a302f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:19.550695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86831ca5-98cb-4424-a897-b3dd8b1a302f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:19.551405 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86831ca5-98cb-4424-a897-b3dd8b1a302f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:19.616294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-86831ca5-98cb-4424-a897-b3dd8b1a302f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:19.624201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-86831ca5-98cb-4424-a897-b3dd8b1a302f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.087776 Nov 08 18:09:19.624752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1290/2578] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:20.640157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-9aebf4cf-6a03-48d7-af6e-486e2edd8030 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:20.640825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-9aebf4cf-6a03-48d7-af6e-486e2edd8030 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:20.647646 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9aebf4cf-6a03-48d7-af6e-486e2edd8030 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:20.648095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9aebf4cf-6a03-48d7-af6e-486e2edd8030 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:20.648901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9aebf4cf-6a03-48d7-af6e-486e2edd8030 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:20.649335 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-9aebf4cf-6a03-48d7-af6e-486e2edd8030 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:20.712769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-9aebf4cf-6a03-48d7-af6e-486e2edd8030 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:20.720625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-9aebf4cf-6a03-48d7-af6e-486e2edd8030 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.084257 Nov 08 18:09:20.721357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1289/2579] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:21.736824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c7ac1ae4-95d5-48fd-82ed-ce48767f72c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:21.738965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c7ac1ae4-95d5-48fd-82ed-ce48767f72c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:21.744477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7ac1ae4-95d5-48fd-82ed-ce48767f72c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:21.744924 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7ac1ae4-95d5-48fd-82ed-ce48767f72c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:21.745689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7ac1ae4-95d5-48fd-82ed-ce48767f72c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:21.746125 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c7ac1ae4-95d5-48fd-82ed-ce48767f72c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:21.808578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c7ac1ae4-95d5-48fd-82ed-ce48767f72c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:21.816310 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c7ac1ae4-95d5-48fd-82ed-ce48767f72c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.083137 Nov 08 18:09:21.816860 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1291/2580] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:22.832511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e4a25672-0a6e-4444-bcec-034a267e2240 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:22.833293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e4a25672-0a6e-4444-bcec-034a267e2240 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:22.839540 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4a25672-0a6e-4444-bcec-034a267e2240 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:22.839975 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4a25672-0a6e-4444-bcec-034a267e2240 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:22.840730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4a25672-0a6e-4444-bcec-034a267e2240 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:22.841186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e4a25672-0a6e-4444-bcec-034a267e2240 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:22.899315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e4a25672-0a6e-4444-bcec-034a267e2240 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:22.906896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e4a25672-0a6e-4444-bcec-034a267e2240 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077986 Nov 08 18:09:22.907449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1290/2581] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:23.923240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dcd8880f-d67f-4031-91fb-a2ef34aa9904 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:23.923861 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dcd8880f-d67f-4031-91fb-a2ef34aa9904 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:23.930647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcd8880f-d67f-4031-91fb-a2ef34aa9904 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:23.931099 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcd8880f-d67f-4031-91fb-a2ef34aa9904 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:23.931875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcd8880f-d67f-4031-91fb-a2ef34aa9904 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:23.932313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcd8880f-d67f-4031-91fb-a2ef34aa9904 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:23.993369 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dcd8880f-d67f-4031-91fb-a2ef34aa9904 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:24.001208 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dcd8880f-d67f-4031-91fb-a2ef34aa9904 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081634 Nov 08 18:09:24.001764 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1292/2582] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:25.018256 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d7abc6a1-f9a2-4f99-9e60-cd09f9b848b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:25.019558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d7abc6a1-f9a2-4f99-9e60-cd09f9b848b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:25.025780 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7abc6a1-f9a2-4f99-9e60-cd09f9b848b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:25.026222 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7abc6a1-f9a2-4f99-9e60-cd09f9b848b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:25.027009 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7abc6a1-f9a2-4f99-9e60-cd09f9b848b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:25.027441 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7abc6a1-f9a2-4f99-9e60-cd09f9b848b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:25.085145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d7abc6a1-f9a2-4f99-9e60-cd09f9b848b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:25.092842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d7abc6a1-f9a2-4f99-9e60-cd09f9b848b3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078304 Nov 08 18:09:25.093409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1291/2583] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:26.109716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-91840ea6-1a76-4d97-99f7-fcfddc38196c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:26.110438 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-91840ea6-1a76-4d97-99f7-fcfddc38196c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:26.117441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91840ea6-1a76-4d97-99f7-fcfddc38196c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:26.117889 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91840ea6-1a76-4d97-99f7-fcfddc38196c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:26.118680 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91840ea6-1a76-4d97-99f7-fcfddc38196c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:26.119111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91840ea6-1a76-4d97-99f7-fcfddc38196c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:26.176827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-91840ea6-1a76-4d97-99f7-fcfddc38196c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:26.184327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-91840ea6-1a76-4d97-99f7-fcfddc38196c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078289 Nov 08 18:09:26.184875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1293/2584] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:27.200194 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dbab3b5d-c7c6-4db3-b406-62b7b4fe9fae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:27.200790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dbab3b5d-c7c6-4db3-b406-62b7b4fe9fae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:27.206977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dbab3b5d-c7c6-4db3-b406-62b7b4fe9fae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:27.207422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dbab3b5d-c7c6-4db3-b406-62b7b4fe9fae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:27.208189 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dbab3b5d-c7c6-4db3-b406-62b7b4fe9fae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:27.208636 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dbab3b5d-c7c6-4db3-b406-62b7b4fe9fae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:27.271133 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dbab3b5d-c7c6-4db3-b406-62b7b4fe9fae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:27.279084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dbab3b5d-c7c6-4db3-b406-62b7b4fe9fae tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082707 Nov 08 18:09:27.279652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1292/2585] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:28.296243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7611ce3e-a9da-40ec-8bf3-10c77a67fd8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:28.296799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7611ce3e-a9da-40ec-8bf3-10c77a67fd8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:28.303059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7611ce3e-a9da-40ec-8bf3-10c77a67fd8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:28.303508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7611ce3e-a9da-40ec-8bf3-10c77a67fd8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:28.304281 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7611ce3e-a9da-40ec-8bf3-10c77a67fd8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:28.304718 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7611ce3e-a9da-40ec-8bf3-10c77a67fd8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:28.366761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7611ce3e-a9da-40ec-8bf3-10c77a67fd8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:28.374374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7611ce3e-a9da-40ec-8bf3-10c77a67fd8b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081891 Nov 08 18:09:28.374959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1294/2586] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:29.391059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-04f4a79c-e30f-421e-ae67-2cbf7923ce22 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:29.391693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-04f4a79c-e30f-421e-ae67-2cbf7923ce22 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:29.398404 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04f4a79c-e30f-421e-ae67-2cbf7923ce22 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:29.398878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04f4a79c-e30f-421e-ae67-2cbf7923ce22 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:29.399639 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04f4a79c-e30f-421e-ae67-2cbf7923ce22 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:29.400073 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04f4a79c-e30f-421e-ae67-2cbf7923ce22 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:29.458106 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-04f4a79c-e30f-421e-ae67-2cbf7923ce22 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:29.465689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-04f4a79c-e30f-421e-ae67-2cbf7923ce22 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078361 Nov 08 18:09:29.466239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1293/2587] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:30.482747 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-28e3f0de-b841-4911-8c89-a36993fe20b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:30.483352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-28e3f0de-b841-4911-8c89-a36993fe20b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:30.489679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-28e3f0de-b841-4911-8c89-a36993fe20b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:30.490121 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-28e3f0de-b841-4911-8c89-a36993fe20b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:30.490917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-28e3f0de-b841-4911-8c89-a36993fe20b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:30.491347 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-28e3f0de-b841-4911-8c89-a36993fe20b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:30.550022 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-28e3f0de-b841-4911-8c89-a36993fe20b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:30.557964 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-28e3f0de-b841-4911-8c89-a36993fe20b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078763 Nov 08 18:09:30.558534 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1295/2588] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:31.574297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-514ff295-8233-4ddc-81b6-45bd7d812c0d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:31.574940 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-514ff295-8233-4ddc-81b6-45bd7d812c0d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:31.581284 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-514ff295-8233-4ddc-81b6-45bd7d812c0d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:31.581778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-514ff295-8233-4ddc-81b6-45bd7d812c0d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:31.582591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-514ff295-8233-4ddc-81b6-45bd7d812c0d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:31.583031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-514ff295-8233-4ddc-81b6-45bd7d812c0d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:31.645836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-514ff295-8233-4ddc-81b6-45bd7d812c0d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:31.653781 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-514ff295-8233-4ddc-81b6-45bd7d812c0d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.083147 Nov 08 18:09:31.654502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1294/2589] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:32.670989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e9a94b3e-4748-4300-95bf-9d71722ed31f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:32.671626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e9a94b3e-4748-4300-95bf-9d71722ed31f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:32.678374 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e9a94b3e-4748-4300-95bf-9d71722ed31f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:32.678851 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e9a94b3e-4748-4300-95bf-9d71722ed31f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:32.679627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e9a94b3e-4748-4300-95bf-9d71722ed31f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:32.680064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e9a94b3e-4748-4300-95bf-9d71722ed31f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:32.742835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e9a94b3e-4748-4300-95bf-9d71722ed31f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:32.747952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e9a94b3e-4748-4300-95bf-9d71722ed31f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080630 Nov 08 18:09:32.748522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1296/2590] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:33.765225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-25309551-ed38-452a-8f84-f6ae255dccf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:33.765852 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-25309551-ed38-452a-8f84-f6ae255dccf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:33.772988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-25309551-ed38-452a-8f84-f6ae255dccf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:33.773435 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-25309551-ed38-452a-8f84-f6ae255dccf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:33.774197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-25309551-ed38-452a-8f84-f6ae255dccf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:33.774661 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-25309551-ed38-452a-8f84-f6ae255dccf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:33.832593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-25309551-ed38-452a-8f84-f6ae255dccf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:33.840209 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-25309551-ed38-452a-8f84-f6ae255dccf5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078610 Nov 08 18:09:33.840766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1295/2591] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:34.857021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-86199519-888c-4b8c-bf1c-5fdbfd03ef9b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:34.857632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-86199519-888c-4b8c-bf1c-5fdbfd03ef9b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:34.863775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86199519-888c-4b8c-bf1c-5fdbfd03ef9b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:34.864220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86199519-888c-4b8c-bf1c-5fdbfd03ef9b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:34.864980 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86199519-888c-4b8c-bf1c-5fdbfd03ef9b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:34.865407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86199519-888c-4b8c-bf1c-5fdbfd03ef9b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:34.925193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-86199519-888c-4b8c-bf1c-5fdbfd03ef9b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:34.932966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-86199519-888c-4b8c-bf1c-5fdbfd03ef9b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079810 Nov 08 18:09:34.933525 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1297/2592] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:35.949128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-35887a94-a8a1-4fda-8bf7-a11943843f85 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:35.949534 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-35887a94-a8a1-4fda-8bf7-a11943843f85 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:35.955750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-35887a94-a8a1-4fda-8bf7-a11943843f85 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:35.957017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-35887a94-a8a1-4fda-8bf7-a11943843f85 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:35.957277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-35887a94-a8a1-4fda-8bf7-a11943843f85 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:35.957709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-35887a94-a8a1-4fda-8bf7-a11943843f85 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:36.020094 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-35887a94-a8a1-4fda-8bf7-a11943843f85 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:36.026039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-35887a94-a8a1-4fda-8bf7-a11943843f85 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080787 Nov 08 18:09:36.026625 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1296/2593] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:37.043095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5dceb0ac-d20c-4e56-b8c8-7adbb2bd5567 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:37.043728 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5dceb0ac-d20c-4e56-b8c8-7adbb2bd5567 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:37.049901 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5dceb0ac-d20c-4e56-b8c8-7adbb2bd5567 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:37.050905 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5dceb0ac-d20c-4e56-b8c8-7adbb2bd5567 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:37.051673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5dceb0ac-d20c-4e56-b8c8-7adbb2bd5567 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:37.052106 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5dceb0ac-d20c-4e56-b8c8-7adbb2bd5567 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:37.109865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5dceb0ac-d20c-4e56-b8c8-7adbb2bd5567 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:37.118053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5dceb0ac-d20c-4e56-b8c8-7adbb2bd5567 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078626 Nov 08 18:09:37.118634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1298/2594] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:38.134341 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d7570786-7946-4d52-a1ac-085582c71f47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:38.134968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d7570786-7946-4d52-a1ac-085582c71f47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:38.141096 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7570786-7946-4d52-a1ac-085582c71f47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:38.141538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7570786-7946-4d52-a1ac-085582c71f47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:38.142294 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7570786-7946-4d52-a1ac-085582c71f47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:38.142753 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d7570786-7946-4d52-a1ac-085582c71f47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:38.200027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d7570786-7946-4d52-a1ac-085582c71f47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:38.208530 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d7570786-7946-4d52-a1ac-085582c71f47 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077847 Nov 08 18:09:38.209288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1297/2595] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:39.225026 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f2aad49e-ca59-43b4-addd-13605e74b306 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:39.225664 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f2aad49e-ca59-43b4-addd-13605e74b306 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:39.231915 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2aad49e-ca59-43b4-addd-13605e74b306 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:39.232359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2aad49e-ca59-43b4-addd-13605e74b306 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:39.233132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2aad49e-ca59-43b4-addd-13605e74b306 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:39.233565 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f2aad49e-ca59-43b4-addd-13605e74b306 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:39.291989 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f2aad49e-ca59-43b4-addd-13605e74b306 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:39.299610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f2aad49e-ca59-43b4-addd-13605e74b306 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078268 Nov 08 18:09:39.300687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1299/2596] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:40.316885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-babc883b-d0ec-45cb-aea8-1ae332756363 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:40.317468 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-babc883b-d0ec-45cb-aea8-1ae332756363 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:40.323922 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-babc883b-d0ec-45cb-aea8-1ae332756363 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:40.324360 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-babc883b-d0ec-45cb-aea8-1ae332756363 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:40.325117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-babc883b-d0ec-45cb-aea8-1ae332756363 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:40.325544 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-babc883b-d0ec-45cb-aea8-1ae332756363 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:40.383768 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-babc883b-d0ec-45cb-aea8-1ae332756363 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:40.391350 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-babc883b-d0ec-45cb-aea8-1ae332756363 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078852 Nov 08 18:09:40.391912 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1298/2597] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:41.407425 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fd14df0a-cb65-42d1-bf37-0a65413cf85c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:41.408032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fd14df0a-cb65-42d1-bf37-0a65413cf85c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:41.414927 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd14df0a-cb65-42d1-bf37-0a65413cf85c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:41.419591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd14df0a-cb65-42d1-bf37-0a65413cf85c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:41.419591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd14df0a-cb65-42d1-bf37-0a65413cf85c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:41.419591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fd14df0a-cb65-42d1-bf37-0a65413cf85c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:41.478954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fd14df0a-cb65-42d1-bf37-0a65413cf85c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:41.486628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fd14df0a-cb65-42d1-bf37-0a65413cf85c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082886 Nov 08 18:09:41.487177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1300/2598] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:09:42.503355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f142297d-dca2-4808-949a-f0c7c4e03c61 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:42.504144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f142297d-dca2-4808-949a-f0c7c4e03c61 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:42.509936 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f142297d-dca2-4808-949a-f0c7c4e03c61 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:42.510384 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f142297d-dca2-4808-949a-f0c7c4e03c61 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:42.511174 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f142297d-dca2-4808-949a-f0c7c4e03c61 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:42.511603 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f142297d-dca2-4808-949a-f0c7c4e03c61 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:42.569369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f142297d-dca2-4808-949a-f0c7c4e03c61 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:42.576982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f142297d-dca2-4808-949a-f0c7c4e03c61 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077521 Nov 08 18:09:42.577538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1299/2599] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:43.592905 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bfea3afe-a531-434e-9dc2-2c7b4f6688e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:43.593432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bfea3afe-a531-434e-9dc2-2c7b4f6688e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:43.600314 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfea3afe-a531-434e-9dc2-2c7b4f6688e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:43.600767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfea3afe-a531-434e-9dc2-2c7b4f6688e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:43.601541 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfea3afe-a531-434e-9dc2-2c7b4f6688e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:43.601985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bfea3afe-a531-434e-9dc2-2c7b4f6688e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:43.661379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bfea3afe-a531-434e-9dc2-2c7b4f6688e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:43.669114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bfea3afe-a531-434e-9dc2-2c7b4f6688e6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080000 Nov 08 18:09:43.669679 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1301/2600] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:44.686179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dbd4ae72-e9c8-44e5-a87c-8ed931c6b6b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:44.686825 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dbd4ae72-e9c8-44e5-a87c-8ed931c6b6b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:44.693369 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dbd4ae72-e9c8-44e5-a87c-8ed931c6b6b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:44.693811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dbd4ae72-e9c8-44e5-a87c-8ed931c6b6b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:44.694652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dbd4ae72-e9c8-44e5-a87c-8ed931c6b6b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:44.695086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dbd4ae72-e9c8-44e5-a87c-8ed931c6b6b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:44.754273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dbd4ae72-e9c8-44e5-a87c-8ed931c6b6b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:44.762059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dbd4ae72-e9c8-44e5-a87c-8ed931c6b6b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079551 Nov 08 18:09:44.762652 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1300/2601] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:45.779222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e464578a-c70e-45d8-9334-cb2519fd4971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:45.779831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e464578a-c70e-45d8-9334-cb2519fd4971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:45.786641 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e464578a-c70e-45d8-9334-cb2519fd4971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:45.787100 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e464578a-c70e-45d8-9334-cb2519fd4971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:45.788754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e464578a-c70e-45d8-9334-cb2519fd4971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:45.788754 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e464578a-c70e-45d8-9334-cb2519fd4971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:45.848249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e464578a-c70e-45d8-9334-cb2519fd4971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:45.855954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e464578a-c70e-45d8-9334-cb2519fd4971 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080425 Nov 08 18:09:45.856516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1302/2602] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:46.874315 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-7e7e301a-6c6c-4007-826c-da1a596e93c2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:46.874935 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-7e7e301a-6c6c-4007-826c-da1a596e93c2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:46.881272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7e7e301a-6c6c-4007-826c-da1a596e93c2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:46.881722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7e7e301a-6c6c-4007-826c-da1a596e93c2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:46.882514 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7e7e301a-6c6c-4007-826c-da1a596e93c2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:46.882950 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-7e7e301a-6c6c-4007-826c-da1a596e93c2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:46.939941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-7e7e301a-6c6c-4007-826c-da1a596e93c2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:46.947559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-7e7e301a-6c6c-4007-826c-da1a596e93c2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.076982 Nov 08 18:09:46.948115 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1301/2603] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:47.964260 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1ce9a6e3-c0bb-4cdd-a320-4f44324747c1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:47.964884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1ce9a6e3-c0bb-4cdd-a320-4f44324747c1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:47.971373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ce9a6e3-c0bb-4cdd-a320-4f44324747c1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:47.972569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ce9a6e3-c0bb-4cdd-a320-4f44324747c1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:47.973529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ce9a6e3-c0bb-4cdd-a320-4f44324747c1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:47.973970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1ce9a6e3-c0bb-4cdd-a320-4f44324747c1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:48.034787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1ce9a6e3-c0bb-4cdd-a320-4f44324747c1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:48.042733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1ce9a6e3-c0bb-4cdd-a320-4f44324747c1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082103 Nov 08 18:09:48.043296 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1303/2604] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:49.059791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-22dee0ba-0914-4ea8-bd45-8cfc10194359 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:49.060397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-22dee0ba-0914-4ea8-bd45-8cfc10194359 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:49.067377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-22dee0ba-0914-4ea8-bd45-8cfc10194359 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:49.067822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-22dee0ba-0914-4ea8-bd45-8cfc10194359 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:49.068590 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-22dee0ba-0914-4ea8-bd45-8cfc10194359 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:49.069022 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-22dee0ba-0914-4ea8-bd45-8cfc10194359 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:49.126118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-22dee0ba-0914-4ea8-bd45-8cfc10194359 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:49.134521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-22dee0ba-0914-4ea8-bd45-8cfc10194359 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078427 Nov 08 18:09:49.135083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1302/2605] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:50.150637 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7254aefc-7338-499c-9afb-9cc10395d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:50.151250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7254aefc-7338-499c-9afb-9cc10395d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:50.157621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7254aefc-7338-499c-9afb-9cc10395d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:50.158064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7254aefc-7338-499c-9afb-9cc10395d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:50.158859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7254aefc-7338-499c-9afb-9cc10395d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:50.159387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7254aefc-7338-499c-9afb-9cc10395d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:50.217485 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7254aefc-7338-499c-9afb-9cc10395d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:50.225714 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7254aefc-7338-499c-9afb-9cc10395d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078717 Nov 08 18:09:50.226280 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1304/2606] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:51.242268 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fc6e7594-3a81-4eab-9fda-16a114522760 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:51.242867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fc6e7594-3a81-4eab-9fda-16a114522760 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:51.249003 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fc6e7594-3a81-4eab-9fda-16a114522760 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:51.249437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fc6e7594-3a81-4eab-9fda-16a114522760 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:51.250192 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fc6e7594-3a81-4eab-9fda-16a114522760 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:51.250647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fc6e7594-3a81-4eab-9fda-16a114522760 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:51.309300 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fc6e7594-3a81-4eab-9fda-16a114522760 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:51.317105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fc6e7594-3a81-4eab-9fda-16a114522760 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078579 Nov 08 18:09:51.319754 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1303/2607] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:52.336740 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c4cd9753-ee76-42f2-b6f4-f117edddbd4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:52.337359 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c4cd9753-ee76-42f2-b6f4-f117edddbd4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:52.343763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4cd9753-ee76-42f2-b6f4-f117edddbd4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:52.344493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4cd9753-ee76-42f2-b6f4-f117edddbd4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:52.345276 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4cd9753-ee76-42f2-b6f4-f117edddbd4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:52.345716 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c4cd9753-ee76-42f2-b6f4-f117edddbd4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:52.405090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c4cd9753-ee76-42f2-b6f4-f117edddbd4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:52.412884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c4cd9753-ee76-42f2-b6f4-f117edddbd4a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081049 Nov 08 18:09:52.413441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1305/2608] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:53.429278 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2dcf9ce2-077a-4e6e-941e-fa30ea72df26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:53.429890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2dcf9ce2-077a-4e6e-941e-fa30ea72df26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:53.436171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dcf9ce2-077a-4e6e-941e-fa30ea72df26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:53.436610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dcf9ce2-077a-4e6e-941e-fa30ea72df26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:53.437366 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dcf9ce2-077a-4e6e-941e-fa30ea72df26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:53.437792 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2dcf9ce2-077a-4e6e-941e-fa30ea72df26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:53.500927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2dcf9ce2-077a-4e6e-941e-fa30ea72df26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:53.509394 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2dcf9ce2-077a-4e6e-941e-fa30ea72df26 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.084255 Nov 08 18:09:53.509888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1304/2609] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:54.525683 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e6bd0a50-6a6e-442c-a222-f5e2fd66ee55 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:54.526293 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e6bd0a50-6a6e-442c-a222-f5e2fd66ee55 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:54.532585 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e6bd0a50-6a6e-442c-a222-f5e2fd66ee55 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:54.533050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e6bd0a50-6a6e-442c-a222-f5e2fd66ee55 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:54.533799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e6bd0a50-6a6e-442c-a222-f5e2fd66ee55 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:54.534236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e6bd0a50-6a6e-442c-a222-f5e2fd66ee55 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:54.596569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e6bd0a50-6a6e-442c-a222-f5e2fd66ee55 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:54.604302 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e6bd0a50-6a6e-442c-a222-f5e2fd66ee55 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082320 Nov 08 18:09:54.604863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1306/2610] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:55.620531 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8d46c8ea-b386-4f09-a54f-56d2b2e0d11f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:55.621150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8d46c8ea-b386-4f09-a54f-56d2b2e0d11f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:55.627396 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d46c8ea-b386-4f09-a54f-56d2b2e0d11f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:55.628483 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d46c8ea-b386-4f09-a54f-56d2b2e0d11f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:55.629375 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d46c8ea-b386-4f09-a54f-56d2b2e0d11f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:55.629841 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8d46c8ea-b386-4f09-a54f-56d2b2e0d11f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:55.687245 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8d46c8ea-b386-4f09-a54f-56d2b2e0d11f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:55.695722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8d46c8ea-b386-4f09-a54f-56d2b2e0d11f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078855 Nov 08 18:09:55.696277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1305/2611] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:56.712822 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6f275439-d9d4-4d9a-8a74-60bad67b26e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:56.713432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6f275439-d9d4-4d9a-8a74-60bad67b26e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:56.719971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f275439-d9d4-4d9a-8a74-60bad67b26e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:56.720416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f275439-d9d4-4d9a-8a74-60bad67b26e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:56.721181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f275439-d9d4-4d9a-8a74-60bad67b26e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:56.722294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f275439-d9d4-4d9a-8a74-60bad67b26e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:56.780615 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6f275439-d9d4-4d9a-8a74-60bad67b26e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:56.788570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6f275439-d9d4-4d9a-8a74-60bad67b26e0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079401 Nov 08 18:09:56.789131 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1307/2612] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:57.805367 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0b56b19a-6925-44ec-91a2-4393da3f758c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:57.805962 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0b56b19a-6925-44ec-91a2-4393da3f758c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:57.812157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b56b19a-6925-44ec-91a2-4393da3f758c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:57.812596 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b56b19a-6925-44ec-91a2-4393da3f758c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:57.813351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b56b19a-6925-44ec-91a2-4393da3f758c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:57.813774 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0b56b19a-6925-44ec-91a2-4393da3f758c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:57.873462 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0b56b19a-6925-44ec-91a2-4393da3f758c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:57.881323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0b56b19a-6925-44ec-91a2-4393da3f758c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079670 Nov 08 18:09:57.881891 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1306/2613] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:58.898205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b4bd1ae9-a2bc-40ca-98e4-ebe1201bbfa3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:58.898828 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b4bd1ae9-a2bc-40ca-98e4-ebe1201bbfa3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:58.905010 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4bd1ae9-a2bc-40ca-98e4-ebe1201bbfa3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:58.905447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4bd1ae9-a2bc-40ca-98e4-ebe1201bbfa3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:58.906203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4bd1ae9-a2bc-40ca-98e4-ebe1201bbfa3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:58.906662 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b4bd1ae9-a2bc-40ca-98e4-ebe1201bbfa3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:58.964409 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b4bd1ae9-a2bc-40ca-98e4-ebe1201bbfa3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:09:58.972858 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b4bd1ae9-a2bc-40ca-98e4-ebe1201bbfa3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078408 Nov 08 18:09:58.973408 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1308/2614] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:09:59.988651 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-08f22413-4580-4d3b-90f1-953c2f8c8d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:09:59.989961 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-08f22413-4580-4d3b-90f1-953c2f8c8d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:09:59.996277 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08f22413-4580-4d3b-90f1-953c2f8c8d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:59.996728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08f22413-4580-4d3b-90f1-953c2f8c8d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:09:59.997489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08f22413-4580-4d3b-90f1-953c2f8c8d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:09:59.997913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-08f22413-4580-4d3b-90f1-953c2f8c8d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:00.060732 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-08f22413-4580-4d3b-90f1-953c2f8c8d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:00.069123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-08f22413-4580-4d3b-90f1-953c2f8c8d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.084082 Nov 08 18:10:00.069689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1307/2615] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:09:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:10:01.086303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-35395a2d-3adb-4a39-8361-0ef8beed1afa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:01.086942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-35395a2d-3adb-4a39-8361-0ef8beed1afa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:01.093187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-35395a2d-3adb-4a39-8361-0ef8beed1afa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:01.093632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-35395a2d-3adb-4a39-8361-0ef8beed1afa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:01.094722 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-35395a2d-3adb-4a39-8361-0ef8beed1afa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:01.095154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-35395a2d-3adb-4a39-8361-0ef8beed1afa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:01.156357 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-35395a2d-3adb-4a39-8361-0ef8beed1afa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:01.164367 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-35395a2d-3adb-4a39-8361-0ef8beed1afa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082426 Nov 08 18:10:01.164935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1309/2616] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:10:02.180148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a56a5b23-619d-4617-8064-38be58608bba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:02.180742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a56a5b23-619d-4617-8064-38be58608bba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:02.186863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a56a5b23-619d-4617-8064-38be58608bba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:02.187311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a56a5b23-619d-4617-8064-38be58608bba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:02.188061 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a56a5b23-619d-4617-8064-38be58608bba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:02.188487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a56a5b23-619d-4617-8064-38be58608bba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:02.248318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a56a5b23-619d-4617-8064-38be58608bba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:02.256312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a56a5b23-619d-4617-8064-38be58608bba tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079970 Nov 08 18:10:02.256880 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1308/2617] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:03.272951 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3392e1b9-ae34-4d83-878c-3efa586c1b98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:03.273647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3392e1b9-ae34-4d83-878c-3efa586c1b98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:03.279875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3392e1b9-ae34-4d83-878c-3efa586c1b98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:03.280319 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3392e1b9-ae34-4d83-878c-3efa586c1b98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:03.281089 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3392e1b9-ae34-4d83-878c-3efa586c1b98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:03.281522 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3392e1b9-ae34-4d83-878c-3efa586c1b98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:03.339831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3392e1b9-ae34-4d83-878c-3efa586c1b98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:03.348569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3392e1b9-ae34-4d83-878c-3efa586c1b98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079294 Nov 08 18:10:03.349138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1310/2618] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:04.365457 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d3f636a4-9b82-4c7a-943d-27d6852bfab9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:04.366062 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d3f636a4-9b82-4c7a-943d-27d6852bfab9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:04.372255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d3f636a4-9b82-4c7a-943d-27d6852bfab9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:04.372697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d3f636a4-9b82-4c7a-943d-27d6852bfab9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:04.373456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d3f636a4-9b82-4c7a-943d-27d6852bfab9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:04.373890 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d3f636a4-9b82-4c7a-943d-27d6852bfab9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:04.432297 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d3f636a4-9b82-4c7a-943d-27d6852bfab9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:04.440728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d3f636a4-9b82-4c7a-943d-27d6852bfab9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078841 Nov 08 18:10:04.441299 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1309/2619] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:05.458062 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-abc145c5-ba3f-4b06-8957-32c969223b80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:05.458695 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-abc145c5-ba3f-4b06-8957-32c969223b80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:05.464984 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abc145c5-ba3f-4b06-8957-32c969223b80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:05.465422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abc145c5-ba3f-4b06-8957-32c969223b80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:05.466211 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abc145c5-ba3f-4b06-8957-32c969223b80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:05.466675 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-abc145c5-ba3f-4b06-8957-32c969223b80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:05.525875 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-abc145c5-ba3f-4b06-8957-32c969223b80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:05.533523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-abc145c5-ba3f-4b06-8957-32c969223b80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079763 Nov 08 18:10:05.534085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1311/2620] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:06.550074 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3b519ffa-71f1-4946-af2b-d93ed4ebbc3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:06.550683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3b519ffa-71f1-4946-af2b-d93ed4ebbc3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:06.556803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b519ffa-71f1-4946-af2b-d93ed4ebbc3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:06.557250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b519ffa-71f1-4946-af2b-d93ed4ebbc3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:06.558017 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b519ffa-71f1-4946-af2b-d93ed4ebbc3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:06.558450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3b519ffa-71f1-4946-af2b-d93ed4ebbc3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:06.616109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3b519ffa-71f1-4946-af2b-d93ed4ebbc3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:06.623668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3b519ffa-71f1-4946-af2b-d93ed4ebbc3d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077530 Nov 08 18:10:06.624233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1310/2621] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:07.640077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-79c2d18b-715d-41ae-bb1e-bbfe02d94272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:07.640681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-79c2d18b-715d-41ae-bb1e-bbfe02d94272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:07.646996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79c2d18b-715d-41ae-bb1e-bbfe02d94272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:07.647437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79c2d18b-715d-41ae-bb1e-bbfe02d94272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:07.648191 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79c2d18b-715d-41ae-bb1e-bbfe02d94272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:07.648623 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-79c2d18b-715d-41ae-bb1e-bbfe02d94272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:07.711416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-79c2d18b-715d-41ae-bb1e-bbfe02d94272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:07.719327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-79c2d18b-715d-41ae-bb1e-bbfe02d94272 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082683 Nov 08 18:10:07.719892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1312/2622] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:08.736239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-75122d8e-9b1d-4a63-ba75-5c0795c4ff8d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:08.737690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-75122d8e-9b1d-4a63-ba75-5c0795c4ff8d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:08.743893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75122d8e-9b1d-4a63-ba75-5c0795c4ff8d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:08.746091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75122d8e-9b1d-4a63-ba75-5c0795c4ff8d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:08.746091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75122d8e-9b1d-4a63-ba75-5c0795c4ff8d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:08.746091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75122d8e-9b1d-4a63-ba75-5c0795c4ff8d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:09.061343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-75122d8e-9b1d-4a63-ba75-5c0795c4ff8d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:09.069974 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-75122d8e-9b1d-4a63-ba75-5c0795c4ff8d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.337310 Nov 08 18:10:09.070560 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1311/2623] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:10.086959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-39e4a248-6e50-4303-b78a-bfa0c0289c56 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:10.087574 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-39e4a248-6e50-4303-b78a-bfa0c0289c56 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:10.093717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39e4a248-6e50-4303-b78a-bfa0c0289c56 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:10.094410 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39e4a248-6e50-4303-b78a-bfa0c0289c56 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:10.095188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39e4a248-6e50-4303-b78a-bfa0c0289c56 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:10.095618 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-39e4a248-6e50-4303-b78a-bfa0c0289c56 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:10.153626 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-39e4a248-6e50-4303-b78a-bfa0c0289c56 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:10.161520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-39e4a248-6e50-4303-b78a-bfa0c0289c56 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078211 Nov 08 18:10:10.162075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1313/2624] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:11.177213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-68407779-22c0-4ddf-aab1-1d2e1902ce5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:11.177818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-68407779-22c0-4ddf-aab1-1d2e1902ce5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:11.184689 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68407779-22c0-4ddf-aab1-1d2e1902ce5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:11.185150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68407779-22c0-4ddf-aab1-1d2e1902ce5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:11.185900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68407779-22c0-4ddf-aab1-1d2e1902ce5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:11.186325 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-68407779-22c0-4ddf-aab1-1d2e1902ce5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:11.244299 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-68407779-22c0-4ddf-aab1-1d2e1902ce5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:11.251826 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-68407779-22c0-4ddf-aab1-1d2e1902ce5d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078284 Nov 08 18:10:11.252605 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1312/2625] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:12.268407 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-974220a1-f24a-4eb1-82d9-755f6a779195 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:12.269115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-974220a1-f24a-4eb1-82d9-755f6a779195 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:12.275106 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-974220a1-f24a-4eb1-82d9-755f6a779195 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:12.275553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-974220a1-f24a-4eb1-82d9-755f6a779195 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:12.276334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-974220a1-f24a-4eb1-82d9-755f6a779195 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:12.276756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-974220a1-f24a-4eb1-82d9-755f6a779195 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:12.335119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-974220a1-f24a-4eb1-82d9-755f6a779195 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:12.342788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-974220a1-f24a-4eb1-82d9-755f6a779195 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078242 Nov 08 18:10:12.343351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1314/2626] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:10:13.359377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8560c262-490b-4e68-aa7c-4151c87b2975 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:13.359981 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8560c262-490b-4e68-aa7c-4151c87b2975 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:13.365749 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8560c262-490b-4e68-aa7c-4151c87b2975 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:13.366193 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8560c262-490b-4e68-aa7c-4151c87b2975 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:13.366988 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8560c262-490b-4e68-aa7c-4151c87b2975 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:13.367419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8560c262-490b-4e68-aa7c-4151c87b2975 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:13.426863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8560c262-490b-4e68-aa7c-4151c87b2975 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:13.434521 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8560c262-490b-4e68-aa7c-4151c87b2975 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078973 Nov 08 18:10:13.435086 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1313/2627] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:14.451470 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f42ace0a-1c61-4fea-a2d9-1cc2c4649cb9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:14.452112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f42ace0a-1c61-4fea-a2d9-1cc2c4649cb9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:14.458624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f42ace0a-1c61-4fea-a2d9-1cc2c4649cb9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:14.459057 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f42ace0a-1c61-4fea-a2d9-1cc2c4649cb9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:14.459823 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f42ace0a-1c61-4fea-a2d9-1cc2c4649cb9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:14.460256 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f42ace0a-1c61-4fea-a2d9-1cc2c4649cb9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:14.518750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f42ace0a-1c61-4fea-a2d9-1cc2c4649cb9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:14.526340 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f42ace0a-1c61-4fea-a2d9-1cc2c4649cb9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078552 Nov 08 18:10:14.526939 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1315/2628] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:15.543177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ad3ee735-5d24-4e32-86d2-293609af2b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:15.543729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ad3ee735-5d24-4e32-86d2-293609af2b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:15.550352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad3ee735-5d24-4e32-86d2-293609af2b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:15.550830 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad3ee735-5d24-4e32-86d2-293609af2b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:15.552031 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad3ee735-5d24-4e32-86d2-293609af2b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:15.552466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ad3ee735-5d24-4e32-86d2-293609af2b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:15.611261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ad3ee735-5d24-4e32-86d2-293609af2b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:15.619472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ad3ee735-5d24-4e32-86d2-293609af2b2a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080041 Nov 08 18:10:15.620058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1314/2629] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:16.635717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b3c83ebf-54d2-493a-9b3d-65feedb23bea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:16.636341 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b3c83ebf-54d2-493a-9b3d-65feedb23bea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:16.642576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3c83ebf-54d2-493a-9b3d-65feedb23bea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:16.643025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3c83ebf-54d2-493a-9b3d-65feedb23bea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:16.643792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3c83ebf-54d2-493a-9b3d-65feedb23bea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:16.644228 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b3c83ebf-54d2-493a-9b3d-65feedb23bea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:16.702435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b3c83ebf-54d2-493a-9b3d-65feedb23bea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:16.710890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b3c83ebf-54d2-493a-9b3d-65feedb23bea tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078792 Nov 08 18:10:16.711450 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1316/2630] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:17.728487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-85e6bef9-53d1-4ebe-8577-99e16b26217a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:17.729072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-85e6bef9-53d1-4ebe-8577-99e16b26217a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:17.735305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85e6bef9-53d1-4ebe-8577-99e16b26217a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:17.739326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85e6bef9-53d1-4ebe-8577-99e16b26217a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:17.739326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85e6bef9-53d1-4ebe-8577-99e16b26217a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:17.739326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-85e6bef9-53d1-4ebe-8577-99e16b26217a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:17.795314 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-85e6bef9-53d1-4ebe-8577-99e16b26217a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:17.803436 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-85e6bef9-53d1-4ebe-8577-99e16b26217a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078914 Nov 08 18:10:17.803993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1315/2631] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:18.820339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-764c6e50-759f-4bd0-a91d-98576ac1d72f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:18.820937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-764c6e50-759f-4bd0-a91d-98576ac1d72f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:18.827221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-764c6e50-759f-4bd0-a91d-98576ac1d72f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:18.827669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-764c6e50-759f-4bd0-a91d-98576ac1d72f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:18.828433 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-764c6e50-759f-4bd0-a91d-98576ac1d72f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:18.828871 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-764c6e50-759f-4bd0-a91d-98576ac1d72f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:18.886982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-764c6e50-759f-4bd0-a91d-98576ac1d72f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:18.895120 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-764c6e50-759f-4bd0-a91d-98576ac1d72f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078181 Nov 08 18:10:18.895744 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1317/2632] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:19.911885 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-87e5d47b-66a6-472a-917d-df90fded2c63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:19.912497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-87e5d47b-66a6-472a-917d-df90fded2c63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:19.918730 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-87e5d47b-66a6-472a-917d-df90fded2c63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:19.919186 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-87e5d47b-66a6-472a-917d-df90fded2c63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:19.919967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-87e5d47b-66a6-472a-917d-df90fded2c63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:19.920418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-87e5d47b-66a6-472a-917d-df90fded2c63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:19.981955 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-87e5d47b-66a6-472a-917d-df90fded2c63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:19.990122 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-87e5d47b-66a6-472a-917d-df90fded2c63 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082390 Nov 08 18:10:19.990723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1316/2633] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:21.007245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-19c4bf6e-9a68-49f1-8ffd-435ab6c5515e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:21.007852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-19c4bf6e-9a68-49f1-8ffd-435ab6c5515e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:21.014311 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19c4bf6e-9a68-49f1-8ffd-435ab6c5515e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:21.014794 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19c4bf6e-9a68-49f1-8ffd-435ab6c5515e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:21.015553 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19c4bf6e-9a68-49f1-8ffd-435ab6c5515e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:21.015987 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-19c4bf6e-9a68-49f1-8ffd-435ab6c5515e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:21.074139 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-19c4bf6e-9a68-49f1-8ffd-435ab6c5515e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:21.081762 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-19c4bf6e-9a68-49f1-8ffd-435ab6c5515e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078896 Nov 08 18:10:21.082998 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1318/2634] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:22.099958 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2a0db23f-1741-4c87-85ef-1685c9ff70f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:22.100587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2a0db23f-1741-4c87-85ef-1685c9ff70f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:22.106772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2a0db23f-1741-4c87-85ef-1685c9ff70f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:22.107212 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2a0db23f-1741-4c87-85ef-1685c9ff70f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:22.107969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2a0db23f-1741-4c87-85ef-1685c9ff70f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:22.108397 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2a0db23f-1741-4c87-85ef-1685c9ff70f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:22.165575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2a0db23f-1741-4c87-85ef-1685c9ff70f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:22.173084 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2a0db23f-1741-4c87-85ef-1685c9ff70f6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077817 Nov 08 18:10:22.173641 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1317/2635] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:23.190112 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d83fc07f-68e9-4482-8cc7-59d8547ebfbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:23.190919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d83fc07f-68e9-4482-8cc7-59d8547ebfbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:23.197321 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d83fc07f-68e9-4482-8cc7-59d8547ebfbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:23.197761 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d83fc07f-68e9-4482-8cc7-59d8547ebfbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:23.198563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d83fc07f-68e9-4482-8cc7-59d8547ebfbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:23.198986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d83fc07f-68e9-4482-8cc7-59d8547ebfbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:23.258621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d83fc07f-68e9-4482-8cc7-59d8547ebfbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:23.266521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d83fc07f-68e9-4482-8cc7-59d8547ebfbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080046 Nov 08 18:10:23.267086 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1319/2636] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:24.283673 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3d679522-f910-4615-9b53-085eff482f6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:24.284229 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3d679522-f910-4615-9b53-085eff482f6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:24.290602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d679522-f910-4615-9b53-085eff482f6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:24.291054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d679522-f910-4615-9b53-085eff482f6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:24.291822 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d679522-f910-4615-9b53-085eff482f6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:24.292255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3d679522-f910-4615-9b53-085eff482f6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:24.350967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3d679522-f910-4615-9b53-085eff482f6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:24.358569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3d679522-f910-4615-9b53-085eff482f6e tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078619 Nov 08 18:10:24.359129 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1318/2637] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:25.375464 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7844373e-c318-4a43-be01-8cb4dd59147f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:25.376073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7844373e-c318-4a43-be01-8cb4dd59147f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:25.382971 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7844373e-c318-4a43-be01-8cb4dd59147f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:25.383416 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7844373e-c318-4a43-be01-8cb4dd59147f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:25.384187 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7844373e-c318-4a43-be01-8cb4dd59147f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:25.384621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7844373e-c318-4a43-be01-8cb4dd59147f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:25.442688 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7844373e-c318-4a43-be01-8cb4dd59147f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:25.450330 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7844373e-c318-4a43-be01-8cb4dd59147f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078601 Nov 08 18:10:25.450935 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1320/2638] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:26.467470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ce479081-d859-432e-9a52-84eb74d99d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:26.468067 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ce479081-d859-432e-9a52-84eb74d99d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:26.475248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce479081-d859-432e-9a52-84eb74d99d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:26.475703 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce479081-d859-432e-9a52-84eb74d99d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:26.476468 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce479081-d859-432e-9a52-84eb74d99d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:26.476900 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce479081-d859-432e-9a52-84eb74d99d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:26.539206 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ce479081-d859-432e-9a52-84eb74d99d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:26.546834 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ce479081-d859-432e-9a52-84eb74d99d1c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082975 Nov 08 18:10:26.547410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1319/2639] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:27.564038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fb6faaca-98b8-4916-8682-616201a492e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:27.564918 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fb6faaca-98b8-4916-8682-616201a492e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:27.572243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb6faaca-98b8-4916-8682-616201a492e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:27.572692 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb6faaca-98b8-4916-8682-616201a492e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:27.574774 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb6faaca-98b8-4916-8682-616201a492e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:27.575213 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fb6faaca-98b8-4916-8682-616201a492e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:27.639848 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fb6faaca-98b8-4916-8682-616201a492e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:27.649557 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fb6faaca-98b8-4916-8682-616201a492e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.089068 Nov 08 18:10:27.650130 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1321/2640] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:28.668622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aa4efe24-846b-408a-98a2-186bcca995ff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:28.669248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aa4efe24-846b-408a-98a2-186bcca995ff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:28.675491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa4efe24-846b-408a-98a2-186bcca995ff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:28.675931 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa4efe24-846b-408a-98a2-186bcca995ff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:28.676682 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa4efe24-846b-408a-98a2-186bcca995ff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:28.677281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa4efe24-846b-408a-98a2-186bcca995ff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:28.735001 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-aa4efe24-846b-408a-98a2-186bcca995ff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:28.742745 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aa4efe24-846b-408a-98a2-186bcca995ff tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077739 Nov 08 18:10:28.743307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1320/2641] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:29.581351 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:10:29.581877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:10:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:10:29.759108 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d458bd23-b759-492a-8797-0f8bfaf6eb0a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:29.759698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d458bd23-b759-492a-8797-0f8bfaf6eb0a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:29.765938 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d458bd23-b759-492a-8797-0f8bfaf6eb0a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:29.766379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d458bd23-b759-492a-8797-0f8bfaf6eb0a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:29.767222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d458bd23-b759-492a-8797-0f8bfaf6eb0a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:29.767647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d458bd23-b759-492a-8797-0f8bfaf6eb0a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:29.828689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d458bd23-b759-492a-8797-0f8bfaf6eb0a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:29.836480 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d458bd23-b759-492a-8797-0f8bfaf6eb0a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081204 Nov 08 18:10:29.836976 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1322/2642] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:30.549587 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:10:30.550050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:10:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:10:30.853236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-52f6843b-49de-4768-990e-af98d138f44b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:30.853838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-52f6843b-49de-4768-990e-af98d138f44b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:30.860156 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52f6843b-49de-4768-990e-af98d138f44b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:30.860597 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52f6843b-49de-4768-990e-af98d138f44b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:30.861353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52f6843b-49de-4768-990e-af98d138f44b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:30.861778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-52f6843b-49de-4768-990e-af98d138f44b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:30.920235 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-52f6843b-49de-4768-990e-af98d138f44b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:30.928672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-52f6843b-49de-4768-990e-af98d138f44b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079143 Nov 08 18:10:30.929225 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1321/2643] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:10:31.945437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-782620c2-6bf2-48eb-a382-2f3e752e1345 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:31.946045 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-782620c2-6bf2-48eb-a382-2f3e752e1345 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:31.952398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-782620c2-6bf2-48eb-a382-2f3e752e1345 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:31.952847 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-782620c2-6bf2-48eb-a382-2f3e752e1345 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:31.953617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-782620c2-6bf2-48eb-a382-2f3e752e1345 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:31.954050 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-782620c2-6bf2-48eb-a382-2f3e752e1345 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:32.013415 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-782620c2-6bf2-48eb-a382-2f3e752e1345 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:32.021327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-782620c2-6bf2-48eb-a382-2f3e752e1345 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080072 Nov 08 18:10:32.021877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1323/2644] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:33.036767 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b281af0d-7684-4700-917e-ada7148bc992 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:33.037424 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b281af0d-7684-4700-917e-ada7148bc992 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:33.043677 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b281af0d-7684-4700-917e-ada7148bc992 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:33.044121 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b281af0d-7684-4700-917e-ada7148bc992 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:33.044888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b281af0d-7684-4700-917e-ada7148bc992 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:33.045318 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b281af0d-7684-4700-917e-ada7148bc992 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:33.106376 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b281af0d-7684-4700-917e-ada7148bc992 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:33.114007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b281af0d-7684-4700-917e-ada7148bc992 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080926 Nov 08 18:10:33.114584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1322/2645] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:34.131163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c43ec9ad-c6d5-4178-9240-1340c06e5fa9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:34.131773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c43ec9ad-c6d5-4178-9240-1340c06e5fa9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:34.137990 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c43ec9ad-c6d5-4178-9240-1340c06e5fa9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:34.138432 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c43ec9ad-c6d5-4178-9240-1340c06e5fa9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:34.139221 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c43ec9ad-c6d5-4178-9240-1340c06e5fa9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:34.139649 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c43ec9ad-c6d5-4178-9240-1340c06e5fa9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:34.199088 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c43ec9ad-c6d5-4178-9240-1340c06e5fa9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:34.206837 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c43ec9ad-c6d5-4178-9240-1340c06e5fa9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079435 Nov 08 18:10:34.207391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1324/2646] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:35.137205 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:10:35.137805 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:10:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:10:35.223898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-31f9ecd2-12ea-442d-91c7-6dd39b9d901d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:35.225005 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-31f9ecd2-12ea-442d-91c7-6dd39b9d901d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:35.231236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31f9ecd2-12ea-442d-91c7-6dd39b9d901d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:35.231684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31f9ecd2-12ea-442d-91c7-6dd39b9d901d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:35.232458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31f9ecd2-12ea-442d-91c7-6dd39b9d901d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:35.232894 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-31f9ecd2-12ea-442d-91c7-6dd39b9d901d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:35.291380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-31f9ecd2-12ea-442d-91c7-6dd39b9d901d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:35.299070 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-31f9ecd2-12ea-442d-91c7-6dd39b9d901d tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078797 Nov 08 18:10:35.299634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1323/2647] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:36.316251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f5180ed8-70fb-447b-80ee-010a6e62071f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:36.316859 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f5180ed8-70fb-447b-80ee-010a6e62071f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:36.324009 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f5180ed8-70fb-447b-80ee-010a6e62071f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:36.324447 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f5180ed8-70fb-447b-80ee-010a6e62071f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:36.325202 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f5180ed8-70fb-447b-80ee-010a6e62071f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:36.325629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f5180ed8-70fb-447b-80ee-010a6e62071f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:36.383872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f5180ed8-70fb-447b-80ee-010a6e62071f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:36.391460 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f5180ed8-70fb-447b-80ee-010a6e62071f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078858 Nov 08 18:10:36.392015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1325/2648] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:37.407814 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-39df1473-b184-4dd6-aa60-df5b66de02b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:37.408423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-39df1473-b184-4dd6-aa60-df5b66de02b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:37.414655 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39df1473-b184-4dd6-aa60-df5b66de02b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:37.415092 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39df1473-b184-4dd6-aa60-df5b66de02b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:37.415846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39df1473-b184-4dd6-aa60-df5b66de02b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:37.416272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-39df1473-b184-4dd6-aa60-df5b66de02b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:37.475691 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-39df1473-b184-4dd6-aa60-df5b66de02b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:37.483213 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-39df1473-b184-4dd6-aa60-df5b66de02b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079066 Nov 08 18:10:37.483786 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1324/2649] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:38.499697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3425e862-4439-4d4a-92fa-df2d71bbe807 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:38.500313 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3425e862-4439-4d4a-92fa-df2d71bbe807 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:38.506578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3425e862-4439-4d4a-92fa-df2d71bbe807 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:38.507029 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3425e862-4439-4d4a-92fa-df2d71bbe807 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:38.507792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3425e862-4439-4d4a-92fa-df2d71bbe807 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:38.508222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3425e862-4439-4d4a-92fa-df2d71bbe807 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:38.565870 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3425e862-4439-4d4a-92fa-df2d71bbe807 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:38.573731 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3425e862-4439-4d4a-92fa-df2d71bbe807 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077709 Nov 08 18:10:38.574294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1326/2650] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:39.590131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2783e1b9-16c0-4cc8-88b6-b7677528ec2b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:39.590722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2783e1b9-16c0-4cc8-88b6-b7677528ec2b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:39.597177 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2783e1b9-16c0-4cc8-88b6-b7677528ec2b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:39.597622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2783e1b9-16c0-4cc8-88b6-b7677528ec2b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:39.598387 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2783e1b9-16c0-4cc8-88b6-b7677528ec2b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:39.598842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2783e1b9-16c0-4cc8-88b6-b7677528ec2b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:39.660449 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2783e1b9-16c0-4cc8-88b6-b7677528ec2b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:39.668298 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2783e1b9-16c0-4cc8-88b6-b7677528ec2b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081877 Nov 08 18:10:39.668861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1325/2651] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:40.684715 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1c8b75f3-dd04-4505-9a4b-c009be170308 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:40.685312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1c8b75f3-dd04-4505-9a4b-c009be170308 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:40.691726 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1c8b75f3-dd04-4505-9a4b-c009be170308 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:40.692181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1c8b75f3-dd04-4505-9a4b-c009be170308 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:40.692957 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1c8b75f3-dd04-4505-9a4b-c009be170308 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:40.693392 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1c8b75f3-dd04-4505-9a4b-c009be170308 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:40.753003 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1c8b75f3-dd04-4505-9a4b-c009be170308 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:40.761126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1c8b75f3-dd04-4505-9a4b-c009be170308 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080055 Nov 08 18:10:40.761689 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1327/2652] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:41.777561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-903aa305-4f71-4899-9933-821386fa008b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:41.778151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-903aa305-4f71-4899-9933-821386fa008b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:41.783967 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-903aa305-4f71-4899-9933-821386fa008b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:41.784413 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-903aa305-4f71-4899-9933-821386fa008b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:41.785179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-903aa305-4f71-4899-9933-821386fa008b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:41.785610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-903aa305-4f71-4899-9933-821386fa008b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:41.844583 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-903aa305-4f71-4899-9933-821386fa008b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:41.853452 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-903aa305-4f71-4899-9933-821386fa008b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079703 Nov 08 18:10:41.854015 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1326/2653] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:42.870613 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4a7d0d9b-1635-4302-83a4-2ada819a796c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:42.871232 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4a7d0d9b-1635-4302-83a4-2ada819a796c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:42.877173 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a7d0d9b-1635-4302-83a4-2ada819a796c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:42.877619 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a7d0d9b-1635-4302-83a4-2ada819a796c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:42.878385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a7d0d9b-1635-4302-83a4-2ada819a796c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:42.878840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4a7d0d9b-1635-4302-83a4-2ada819a796c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:42.938629 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4a7d0d9b-1635-4302-83a4-2ada819a796c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:42.947015 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4a7d0d9b-1635-4302-83a4-2ada819a796c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080086 Nov 08 18:10:42.947584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1328/2654] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:43.963925 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b6ddead0-7b03-4567-adf2-4c66690d65f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:43.964520 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b6ddead0-7b03-4567-adf2-4c66690d65f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:43.971051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6ddead0-7b03-4567-adf2-4c66690d65f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:43.971493 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6ddead0-7b03-4567-adf2-4c66690d65f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:43.972256 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6ddead0-7b03-4567-adf2-4c66690d65f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:43.972688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b6ddead0-7b03-4567-adf2-4c66690d65f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:44.031117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b6ddead0-7b03-4567-adf2-4c66690d65f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:44.038702 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b6ddead0-7b03-4567-adf2-4c66690d65f8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078498 Nov 08 18:10:44.039258 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1327/2655] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:45.055668 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-59c60113-ffdb-4d7a-879e-76ffe3e90e4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:45.056275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-59c60113-ffdb-4d7a-879e-76ffe3e90e4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:45.062684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-59c60113-ffdb-4d7a-879e-76ffe3e90e4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:45.063152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-59c60113-ffdb-4d7a-879e-76ffe3e90e4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:45.063931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-59c60113-ffdb-4d7a-879e-76ffe3e90e4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:45.064362 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-59c60113-ffdb-4d7a-879e-76ffe3e90e4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:45.122289 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-59c60113-ffdb-4d7a-879e-76ffe3e90e4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:45.129950 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-59c60113-ffdb-4d7a-879e-76ffe3e90e4b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078706 Nov 08 18:10:45.130684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1329/2656] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:46.146766 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3e6f9a8b-0b8a-4897-bee9-241100d063da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:46.147348 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3e6f9a8b-0b8a-4897-bee9-241100d063da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:46.153577 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e6f9a8b-0b8a-4897-bee9-241100d063da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:46.154012 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e6f9a8b-0b8a-4897-bee9-241100d063da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:46.154793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e6f9a8b-0b8a-4897-bee9-241100d063da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:46.155220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e6f9a8b-0b8a-4897-bee9-241100d063da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:46.219403 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3e6f9a8b-0b8a-4897-bee9-241100d063da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:46.227871 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3e6f9a8b-0b8a-4897-bee9-241100d063da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.084796 Nov 08 18:10:46.228427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1328/2657] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:47.244380 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ae2ce2c8-7110-41ed-a86a-1a2d60978db2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:47.244966 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ae2ce2c8-7110-41ed-a86a-1a2d60978db2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:47.251124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ae2ce2c8-7110-41ed-a86a-1a2d60978db2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:47.251564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ae2ce2c8-7110-41ed-a86a-1a2d60978db2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:47.252324 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ae2ce2c8-7110-41ed-a86a-1a2d60978db2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:47.252753 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ae2ce2c8-7110-41ed-a86a-1a2d60978db2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:47.311286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ae2ce2c8-7110-41ed-a86a-1a2d60978db2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:47.319497 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ae2ce2c8-7110-41ed-a86a-1a2d60978db2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078870 Nov 08 18:10:47.320075 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1330/2658] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:48.336473 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3da6fba3-f67c-4cd8-97b6-678d20e328b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:48.337040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3da6fba3-f67c-4cd8-97b6-678d20e328b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:48.343219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3da6fba3-f67c-4cd8-97b6-678d20e328b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:48.343919 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3da6fba3-f67c-4cd8-97b6-678d20e328b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:48.344688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3da6fba3-f67c-4cd8-97b6-678d20e328b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:48.345119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3da6fba3-f67c-4cd8-97b6-678d20e328b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:48.403136 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3da6fba3-f67c-4cd8-97b6-678d20e328b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:48.410811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3da6fba3-f67c-4cd8-97b6-678d20e328b7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078722 Nov 08 18:10:48.411477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1329/2659] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:49.428586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-55baaea1-8922-4ea0-9470-4b318ab3ff80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:49.429223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-55baaea1-8922-4ea0-9470-4b318ab3ff80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:49.435532 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55baaea1-8922-4ea0-9470-4b318ab3ff80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:49.435978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55baaea1-8922-4ea0-9470-4b318ab3ff80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:49.436733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55baaea1-8922-4ea0-9470-4b318ab3ff80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:49.437158 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-55baaea1-8922-4ea0-9470-4b318ab3ff80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:49.495508 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-55baaea1-8922-4ea0-9470-4b318ab3ff80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:49.503073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-55baaea1-8922-4ea0-9470-4b318ab3ff80 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078750 Nov 08 18:10:49.503627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1331/2660] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:50.519443 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-197bd52b-0eb8-4a56-9e6d-ca7c022328ca tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:50.520039 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-197bd52b-0eb8-4a56-9e6d-ca7c022328ca tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:50.526511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-197bd52b-0eb8-4a56-9e6d-ca7c022328ca tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:50.526956 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-197bd52b-0eb8-4a56-9e6d-ca7c022328ca tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:50.527763 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-197bd52b-0eb8-4a56-9e6d-ca7c022328ca tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:50.528185 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-197bd52b-0eb8-4a56-9e6d-ca7c022328ca tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:50.585835 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-197bd52b-0eb8-4a56-9e6d-ca7c022328ca tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:50.593420 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-197bd52b-0eb8-4a56-9e6d-ca7c022328ca tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077683 Nov 08 18:10:50.594343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1330/2661] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:51.610210 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-12893e19-1c0f-4813-a70d-54bcfff5fd0b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:51.610799 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-12893e19-1c0f-4813-a70d-54bcfff5fd0b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:51.617126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12893e19-1c0f-4813-a70d-54bcfff5fd0b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:51.617561 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12893e19-1c0f-4813-a70d-54bcfff5fd0b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:51.618323 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12893e19-1c0f-4813-a70d-54bcfff5fd0b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:51.618779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-12893e19-1c0f-4813-a70d-54bcfff5fd0b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:51.676605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-12893e19-1c0f-4813-a70d-54bcfff5fd0b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:51.684253 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-12893e19-1c0f-4813-a70d-54bcfff5fd0b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077763 Nov 08 18:10:51.684809 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1332/2662] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:52.700109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-897b8510-c9db-41c3-8bb2-5257adf6b3b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:52.700737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-897b8510-c9db-41c3-8bb2-5257adf6b3b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:52.706964 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-897b8510-c9db-41c3-8bb2-5257adf6b3b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:52.707401 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-897b8510-c9db-41c3-8bb2-5257adf6b3b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:52.708157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-897b8510-c9db-41c3-8bb2-5257adf6b3b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:52.709088 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-897b8510-c9db-41c3-8bb2-5257adf6b3b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:52.769970 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-897b8510-c9db-41c3-8bb2-5257adf6b3b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:52.778338 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-897b8510-c9db-41c3-8bb2-5257adf6b3b5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081853 Nov 08 18:10:52.783428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1331/2663] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:53.795245 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-95048f1f-69e4-4875-b864-7c57ad27c37b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:53.795897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-95048f1f-69e4-4875-b864-7c57ad27c37b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:53.802016 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95048f1f-69e4-4875-b864-7c57ad27c37b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:53.803111 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95048f1f-69e4-4875-b864-7c57ad27c37b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:53.803959 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95048f1f-69e4-4875-b864-7c57ad27c37b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:53.804388 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-95048f1f-69e4-4875-b864-7c57ad27c37b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:53.861929 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-95048f1f-69e4-4875-b864-7c57ad27c37b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:53.870439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-95048f1f-69e4-4875-b864-7c57ad27c37b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078831 Nov 08 18:10:53.871014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1333/2664] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:54.887343 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0d32ebdd-2531-4e04-baaf-6daea9d8f86b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:54.887986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0d32ebdd-2531-4e04-baaf-6daea9d8f86b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:54.894190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d32ebdd-2531-4e04-baaf-6daea9d8f86b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:54.894684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d32ebdd-2531-4e04-baaf-6daea9d8f86b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:54.895446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d32ebdd-2531-4e04-baaf-6daea9d8f86b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:54.895878 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0d32ebdd-2531-4e04-baaf-6daea9d8f86b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:54.953610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0d32ebdd-2531-4e04-baaf-6daea9d8f86b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:54.961503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0d32ebdd-2531-4e04-baaf-6daea9d8f86b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077784 Nov 08 18:10:54.962065 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1332/2665] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:55.977536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-598332f4-6cb0-4e22-b592-8ed140cd1bc0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:55.978150 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-598332f4-6cb0-4e22-b592-8ed140cd1bc0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:55.984396 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-598332f4-6cb0-4e22-b592-8ed140cd1bc0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:55.984844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-598332f4-6cb0-4e22-b592-8ed140cd1bc0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:55.985620 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-598332f4-6cb0-4e22-b592-8ed140cd1bc0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:55.986054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-598332f4-6cb0-4e22-b592-8ed140cd1bc0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:56.045117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-598332f4-6cb0-4e22-b592-8ed140cd1bc0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:56.052827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-598332f4-6cb0-4e22-b592-8ed140cd1bc0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079123 Nov 08 18:10:56.053382 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1334/2666] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:57.069249 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8ea830b7-7c99-4ff3-9d4c-ffc137fd08e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:57.069854 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8ea830b7-7c99-4ff3-9d4c-ffc137fd08e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:57.076057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ea830b7-7c99-4ff3-9d4c-ffc137fd08e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:57.076497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ea830b7-7c99-4ff3-9d4c-ffc137fd08e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:57.077255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ea830b7-7c99-4ff3-9d4c-ffc137fd08e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:57.077684 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8ea830b7-7c99-4ff3-9d4c-ffc137fd08e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:57.135636 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8ea830b7-7c99-4ff3-9d4c-ffc137fd08e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:57.143169 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8ea830b7-7c99-4ff3-9d4c-ffc137fd08e4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077783 Nov 08 18:10:57.143728 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1333/2667] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:58.160076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a32443b2-7801-4c62-8ad1-398f37264142 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:58.160682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a32443b2-7801-4c62-8ad1-398f37264142 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:58.167264 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a32443b2-7801-4c62-8ad1-398f37264142 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:58.167710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a32443b2-7801-4c62-8ad1-398f37264142 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:58.168477 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a32443b2-7801-4c62-8ad1-398f37264142 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:58.168909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a32443b2-7801-4c62-8ad1-398f37264142 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:58.227002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a32443b2-7801-4c62-8ad1-398f37264142 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:58.234752 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a32443b2-7801-4c62-8ad1-398f37264142 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078318 Nov 08 18:10:58.235339 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1335/2668] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:10:59.251858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fd9eb27b-19ed-413f-b3df-b5b7c36131f1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:10:59.252430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fd9eb27b-19ed-413f-b3df-b5b7c36131f1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:10:59.258695 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd9eb27b-19ed-413f-b3df-b5b7c36131f1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:59.259131 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd9eb27b-19ed-413f-b3df-b5b7c36131f1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:59.259934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd9eb27b-19ed-413f-b3df-b5b7c36131f1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:10:59.260368 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fd9eb27b-19ed-413f-b3df-b5b7c36131f1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:10:59.323436 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fd9eb27b-19ed-413f-b3df-b5b7c36131f1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:10:59.331159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fd9eb27b-19ed-413f-b3df-b5b7c36131f1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.083149 Nov 08 18:10:59.331723 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1334/2669] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:10:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:00.348817 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-5793bd3b-3959-4c56-94bb-0ffc9d8518a5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:00.349459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-5793bd3b-3959-4c56-94bb-0ffc9d8518a5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:00.357666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5793bd3b-3959-4c56-94bb-0ffc9d8518a5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:00.358110 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5793bd3b-3959-4c56-94bb-0ffc9d8518a5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:00.358917 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5793bd3b-3959-4c56-94bb-0ffc9d8518a5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:00.359352 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-5793bd3b-3959-4c56-94bb-0ffc9d8518a5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:00.419625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-5793bd3b-3959-4c56-94bb-0ffc9d8518a5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:00.429155 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-5793bd3b-3959-4c56-94bb-0ffc9d8518a5 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.084036 Nov 08 18:11:00.429719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1336/2670] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:01.446697 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8585c822-be1b-4c3f-80a5-3b45db56827f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:01.447287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8585c822-be1b-4c3f-80a5-3b45db56827f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:01.453433 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8585c822-be1b-4c3f-80a5-3b45db56827f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:01.453877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8585c822-be1b-4c3f-80a5-3b45db56827f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:01.454672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8585c822-be1b-4c3f-80a5-3b45db56827f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:01.455108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8585c822-be1b-4c3f-80a5-3b45db56827f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:01.512679 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8585c822-be1b-4c3f-80a5-3b45db56827f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:01.520248 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8585c822-be1b-4c3f-80a5-3b45db56827f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077907 Nov 08 18:11:01.520808 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1335/2671] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:02.536623 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6a0839e0-a84f-40f0-9a11-f5897d106b82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:02.537312 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6a0839e0-a84f-40f0-9a11-f5897d106b82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:02.543682 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a0839e0-a84f-40f0-9a11-f5897d106b82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:02.544128 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a0839e0-a84f-40f0-9a11-f5897d106b82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:02.544894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a0839e0-a84f-40f0-9a11-f5897d106b82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:02.545387 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6a0839e0-a84f-40f0-9a11-f5897d106b82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:02.605498 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6a0839e0-a84f-40f0-9a11-f5897d106b82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:02.613139 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6a0839e0-a84f-40f0-9a11-f5897d106b82 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080284 Nov 08 18:11:02.613701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1337/2672] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:03.629331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b7d0e248-472a-47f9-81b2-1da7ead01a72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:03.629941 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b7d0e248-472a-47f9-81b2-1da7ead01a72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:03.636409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b7d0e248-472a-47f9-81b2-1da7ead01a72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:03.636859 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b7d0e248-472a-47f9-81b2-1da7ead01a72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:03.637629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b7d0e248-472a-47f9-81b2-1da7ead01a72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:03.638066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b7d0e248-472a-47f9-81b2-1da7ead01a72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:03.696072 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b7d0e248-472a-47f9-81b2-1da7ead01a72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:03.703708 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b7d0e248-472a-47f9-81b2-1da7ead01a72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077997 Nov 08 18:11:03.704272 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1336/2673] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:04.720751 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-901e35a4-c16f-41de-8569-fc5e2276d3de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:04.721345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-901e35a4-c16f-41de-8569-fc5e2276d3de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:04.727576 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-901e35a4-c16f-41de-8569-fc5e2276d3de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:04.728017 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-901e35a4-c16f-41de-8569-fc5e2276d3de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:04.728772 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-901e35a4-c16f-41de-8569-fc5e2276d3de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:04.729218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-901e35a4-c16f-41de-8569-fc5e2276d3de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:04.787617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-901e35a4-c16f-41de-8569-fc5e2276d3de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:04.795515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-901e35a4-c16f-41de-8569-fc5e2276d3de tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078637 Nov 08 18:11:04.796078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1338/2674] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:05.812119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-be85fe5f-6424-4f9e-b4ab-a64910b48eda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:05.812713 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-be85fe5f-6424-4f9e-b4ab-a64910b48eda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:05.819731 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be85fe5f-6424-4f9e-b4ab-a64910b48eda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:05.820179 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be85fe5f-6424-4f9e-b4ab-a64910b48eda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:05.820952 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be85fe5f-6424-4f9e-b4ab-a64910b48eda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:05.821389 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-be85fe5f-6424-4f9e-b4ab-a64910b48eda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:05.882977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-be85fe5f-6424-4f9e-b4ab-a64910b48eda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:05.890656 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-be85fe5f-6424-4f9e-b4ab-a64910b48eda tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082192 Nov 08 18:11:05.891219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1337/2675] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:06.906818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-fdc52e81-6c7b-4a4c-b001-961a5632c0d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:06.907434 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-fdc52e81-6c7b-4a4c-b001-961a5632c0d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:06.914315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdc52e81-6c7b-4a4c-b001-961a5632c0d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:06.914787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdc52e81-6c7b-4a4c-b001-961a5632c0d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:06.915567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdc52e81-6c7b-4a4c-b001-961a5632c0d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:06.916002 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-fdc52e81-6c7b-4a4c-b001-961a5632c0d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:06.973937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-fdc52e81-6c7b-4a4c-b001-961a5632c0d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:06.982117 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-fdc52e81-6c7b-4a4c-b001-961a5632c0d1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078923 Nov 08 18:11:06.982710 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1339/2676] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:07.999055 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-af23c44c-59b2-4236-9914-49e46eef3c42 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:07.999663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-af23c44c-59b2-4236-9914-49e46eef3c42 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:08.006434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-af23c44c-59b2-4236-9914-49e46eef3c42 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:08.006904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-af23c44c-59b2-4236-9914-49e46eef3c42 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:08.007664 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-af23c44c-59b2-4236-9914-49e46eef3c42 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:08.008095 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-af23c44c-59b2-4236-9914-49e46eef3c42 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:08.066569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-af23c44c-59b2-4236-9914-49e46eef3c42 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:08.074818 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-af23c44c-59b2-4236-9914-49e46eef3c42 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079350 Nov 08 18:11:08.075377 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1338/2677] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:09.091149 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-c8a04e02-765d-4b80-a2e8-b231b6e2efcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:09.091780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-c8a04e02-765d-4b80-a2e8-b231b6e2efcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:09.098219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c8a04e02-765d-4b80-a2e8-b231b6e2efcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:09.098705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c8a04e02-765d-4b80-a2e8-b231b6e2efcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:09.099516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c8a04e02-765d-4b80-a2e8-b231b6e2efcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:09.100024 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-c8a04e02-765d-4b80-a2e8-b231b6e2efcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:09.157719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-c8a04e02-765d-4b80-a2e8-b231b6e2efcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:09.165529 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-c8a04e02-765d-4b80-a2e8-b231b6e2efcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078048 Nov 08 18:11:09.166090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1340/2678] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:10.182683 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a2846d4b-a5df-40f6-bd7d-ec12679fb723 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:10.183283 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a2846d4b-a5df-40f6-bd7d-ec12679fb723 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:10.189458 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a2846d4b-a5df-40f6-bd7d-ec12679fb723 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:10.189901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a2846d4b-a5df-40f6-bd7d-ec12679fb723 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:10.190693 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a2846d4b-a5df-40f6-bd7d-ec12679fb723 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:10.191123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a2846d4b-a5df-40f6-bd7d-ec12679fb723 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:10.249594 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a2846d4b-a5df-40f6-bd7d-ec12679fb723 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:10.257913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a2846d4b-a5df-40f6-bd7d-ec12679fb723 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079090 Nov 08 18:11:10.258480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1339/2679] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:11.274516 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-88448df6-2ca0-4dd4-b7d0-3932df119e01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:11.275083 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-88448df6-2ca0-4dd4-b7d0-3932df119e01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:11.281316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-88448df6-2ca0-4dd4-b7d0-3932df119e01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:11.281756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-88448df6-2ca0-4dd4-b7d0-3932df119e01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:11.282539 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-88448df6-2ca0-4dd4-b7d0-3932df119e01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:11.282970 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-88448df6-2ca0-4dd4-b7d0-3932df119e01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:11.341506 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-88448df6-2ca0-4dd4-b7d0-3932df119e01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:11.350642 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-88448df6-2ca0-4dd4-b7d0-3932df119e01 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079112 Nov 08 18:11:11.351218 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1341/2680] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:12.367361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-2726560c-e129-4dc8-8bd9-0b7c7b8950cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:12.368032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-2726560c-e129-4dc8-8bd9-0b7c7b8950cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:12.374100 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2726560c-e129-4dc8-8bd9-0b7c7b8950cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:12.374569 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2726560c-e129-4dc8-8bd9-0b7c7b8950cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:12.375326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2726560c-e129-4dc8-8bd9-0b7c7b8950cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:12.375750 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-2726560c-e129-4dc8-8bd9-0b7c7b8950cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:12.437261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-2726560c-e129-4dc8-8bd9-0b7c7b8950cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:12.445510 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-2726560c-e129-4dc8-8bd9-0b7c7b8950cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082055 Nov 08 18:11:12.446059 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1340/2681] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:13.462435 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-40276928-57f6-47c8-81af-d0565487b434 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:13.463114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-40276928-57f6-47c8-81af-d0565487b434 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:13.469249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40276928-57f6-47c8-81af-d0565487b434 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:13.469685 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40276928-57f6-47c8-81af-d0565487b434 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:13.470439 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40276928-57f6-47c8-81af-d0565487b434 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:13.470897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-40276928-57f6-47c8-81af-d0565487b434 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:13.528602 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-40276928-57f6-47c8-81af-d0565487b434 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:13.536233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-40276928-57f6-47c8-81af-d0565487b434 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078257 Nov 08 18:11:13.536907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1342/2682] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:14.554076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d4be15b6-29ec-487f-8685-a424c2f636cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:14.554696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d4be15b6-29ec-487f-8685-a424c2f636cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:14.560851 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4be15b6-29ec-487f-8685-a424c2f636cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:14.561643 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4be15b6-29ec-487f-8685-a424c2f636cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:14.562408 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4be15b6-29ec-487f-8685-a424c2f636cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:14.562863 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4be15b6-29ec-487f-8685-a424c2f636cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:14.621748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d4be15b6-29ec-487f-8685-a424c2f636cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:14.629311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d4be15b6-29ec-487f-8685-a424c2f636cb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079796 Nov 08 18:11:14.629874 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1341/2683] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:15.645298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e98eba36-d6fb-4743-9123-0ddcf089b4d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:15.645907 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e98eba36-d6fb-4743-9123-0ddcf089b4d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:15.652803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e98eba36-d6fb-4743-9123-0ddcf089b4d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:15.653243 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e98eba36-d6fb-4743-9123-0ddcf089b4d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:15.654000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e98eba36-d6fb-4743-9123-0ddcf089b4d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:15.654424 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e98eba36-d6fb-4743-9123-0ddcf089b4d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:15.712838 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e98eba36-d6fb-4743-9123-0ddcf089b4d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:15.721014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e98eba36-d6fb-4743-9123-0ddcf089b4d3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079329 Nov 08 18:11:15.721570 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1343/2684] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:16.738304 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1fce9682-ae7b-4fba-bae4-98bd24c12608 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:16.738972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1fce9682-ae7b-4fba-bae4-98bd24c12608 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:16.746381 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fce9682-ae7b-4fba-bae4-98bd24c12608 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:16.749508 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fce9682-ae7b-4fba-bae4-98bd24c12608 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:16.749508 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fce9682-ae7b-4fba-bae4-98bd24c12608 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:16.749508 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1fce9682-ae7b-4fba-bae4-98bd24c12608 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:16.808791 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1fce9682-ae7b-4fba-bae4-98bd24c12608 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:16.816527 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1fce9682-ae7b-4fba-bae4-98bd24c12608 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081865 Nov 08 18:11:16.817085 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1342/2685] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:17.832379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7d6f93ff-7a6b-4cee-aeef-285f2b2dbf6c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:17.832944 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7d6f93ff-7a6b-4cee-aeef-285f2b2dbf6c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:17.839358 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d6f93ff-7a6b-4cee-aeef-285f2b2dbf6c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:17.839796 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d6f93ff-7a6b-4cee-aeef-285f2b2dbf6c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:17.840563 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d6f93ff-7a6b-4cee-aeef-285f2b2dbf6c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:17.840991 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7d6f93ff-7a6b-4cee-aeef-285f2b2dbf6c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:17.900140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7d6f93ff-7a6b-4cee-aeef-285f2b2dbf6c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:17.907922 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7d6f93ff-7a6b-4cee-aeef-285f2b2dbf6c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079342 Nov 08 18:11:17.908476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1344/2686] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:18.924105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5a009491-046f-4f1d-b950-3673e93b01aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:18.924714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5a009491-046f-4f1d-b950-3673e93b01aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:18.931266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a009491-046f-4f1d-b950-3673e93b01aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:18.931715 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a009491-046f-4f1d-b950-3673e93b01aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:18.932477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a009491-046f-4f1d-b950-3673e93b01aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:18.932904 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5a009491-046f-4f1d-b950-3673e93b01aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:18.992359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5a009491-046f-4f1d-b950-3673e93b01aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:19.000286 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5a009491-046f-4f1d-b950-3673e93b01aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079850 Nov 08 18:11:19.000861 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1343/2687] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:20.017116 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-cd462426-8f2c-4acc-ab50-75b42b357727 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:20.018400 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-cd462426-8f2c-4acc-ab50-75b42b357727 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:20.026345 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd462426-8f2c-4acc-ab50-75b42b357727 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:20.026841 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd462426-8f2c-4acc-ab50-75b42b357727 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:20.027634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd462426-8f2c-4acc-ab50-75b42b357727 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:20.028072 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-cd462426-8f2c-4acc-ab50-75b42b357727 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:20.089845 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-cd462426-8f2c-4acc-ab50-75b42b357727 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:20.098265 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-cd462426-8f2c-4acc-ab50-75b42b357727 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.084962 Nov 08 18:11:20.099004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1345/2688] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:21.115042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-bb9e3293-1457-4175-ba84-0427cf272fcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:21.115928 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-bb9e3293-1457-4175-ba84-0427cf272fcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:21.122164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb9e3293-1457-4175-ba84-0427cf272fcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:21.122649 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb9e3293-1457-4175-ba84-0427cf272fcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:21.123411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb9e3293-1457-4175-ba84-0427cf272fcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:21.123864 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-bb9e3293-1457-4175-ba84-0427cf272fcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:21.183312 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-bb9e3293-1457-4175-ba84-0427cf272fcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:21.190170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-bb9e3293-1457-4175-ba84-0427cf272fcc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078789 Nov 08 18:11:21.190771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1344/2689] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:22.207033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-be3f6b78-598b-491d-b2a2-03ec00a62004 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:22.207633 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-be3f6b78-598b-491d-b2a2-03ec00a62004 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:22.213937 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be3f6b78-598b-491d-b2a2-03ec00a62004 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:22.214378 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be3f6b78-598b-491d-b2a2-03ec00a62004 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:22.215180 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be3f6b78-598b-491d-b2a2-03ec00a62004 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:22.215610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-be3f6b78-598b-491d-b2a2-03ec00a62004 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:22.273980 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-be3f6b78-598b-491d-b2a2-03ec00a62004 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:22.281566 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-be3f6b78-598b-491d-b2a2-03ec00a62004 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078197 Nov 08 18:11:22.283942 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1346/2690] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:23.297507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-0247b89a-2b46-46e3-8ec0-cf90979c1fa6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:23.298077 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-0247b89a-2b46-46e3-8ec0-cf90979c1fa6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:23.304946 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0247b89a-2b46-46e3-8ec0-cf90979c1fa6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:23.305396 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0247b89a-2b46-46e3-8ec0-cf90979c1fa6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:23.306165 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0247b89a-2b46-46e3-8ec0-cf90979c1fa6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:23.306629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-0247b89a-2b46-46e3-8ec0-cf90979c1fa6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:23.367060 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-0247b89a-2b46-46e3-8ec0-cf90979c1fa6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:23.374725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-0247b89a-2b46-46e3-8ec0-cf90979c1fa6 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080981 Nov 08 18:11:23.375287 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1345/2691] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:24.391979 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1438de03-764e-4999-8222-324227bed866 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:24.392584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1438de03-764e-4999-8222-324227bed866 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:24.399120 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1438de03-764e-4999-8222-324227bed866 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:24.399567 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1438de03-764e-4999-8222-324227bed866 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:24.400334 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1438de03-764e-4999-8222-324227bed866 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:24.400769 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1438de03-764e-4999-8222-324227bed866 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:24.460376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1438de03-764e-4999-8222-324227bed866 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:24.468013 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1438de03-764e-4999-8222-324227bed866 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079729 Nov 08 18:11:24.468844 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1347/2692] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:25.485218 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5e3da29f-c58b-4a6a-9587-76629ae20d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:25.485821 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5e3da29f-c58b-4a6a-9587-76629ae20d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:25.492663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e3da29f-c58b-4a6a-9587-76629ae20d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:25.493103 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e3da29f-c58b-4a6a-9587-76629ae20d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:25.493858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e3da29f-c58b-4a6a-9587-76629ae20d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:25.494288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5e3da29f-c58b-4a6a-9587-76629ae20d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:25.552437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5e3da29f-c58b-4a6a-9587-76629ae20d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:25.560712 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5e3da29f-c58b-4a6a-9587-76629ae20d41 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079092 Nov 08 18:11:25.561281 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1346/2693] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:26.577452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-afad0050-741f-4bfc-b7e0-73bc0e7e6a89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:26.578095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-afad0050-741f-4bfc-b7e0-73bc0e7e6a89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:26.585206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-afad0050-741f-4bfc-b7e0-73bc0e7e6a89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:26.585636 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-afad0050-741f-4bfc-b7e0-73bc0e7e6a89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:26.586422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-afad0050-741f-4bfc-b7e0-73bc0e7e6a89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:26.586895 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-afad0050-741f-4bfc-b7e0-73bc0e7e6a89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:26.648703 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-afad0050-741f-4bfc-b7e0-73bc0e7e6a89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:26.656278 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-afad0050-741f-4bfc-b7e0-73bc0e7e6a89 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082585 Nov 08 18:11:26.656827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1348/2694] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:27.674529 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6a69bf17-3f66-438a-8af2-3d54fccf9745 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:27.675163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6a69bf17-3f66-438a-8af2-3d54fccf9745 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:27.681943 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a69bf17-3f66-438a-8af2-3d54fccf9745 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:27.682388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a69bf17-3f66-438a-8af2-3d54fccf9745 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:27.683187 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a69bf17-3f66-438a-8af2-3d54fccf9745 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:27.683622 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6a69bf17-3f66-438a-8af2-3d54fccf9745 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:27.743659 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6a69bf17-3f66-438a-8af2-3d54fccf9745 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:27.751502 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6a69bf17-3f66-438a-8af2-3d54fccf9745 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080753 Nov 08 18:11:27.752069 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1347/2695] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:28.769204 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-336b3f76-dbb3-41ec-bef8-96cebc72ab98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:28.769877 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-336b3f76-dbb3-41ec-bef8-96cebc72ab98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:28.777143 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-336b3f76-dbb3-41ec-bef8-96cebc72ab98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:28.777589 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-336b3f76-dbb3-41ec-bef8-96cebc72ab98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:28.778614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-336b3f76-dbb3-41ec-bef8-96cebc72ab98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:28.778827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-336b3f76-dbb3-41ec-bef8-96cebc72ab98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:28.849459 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-336b3f76-dbb3-41ec-bef8-96cebc72ab98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:28.858573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-336b3f76-dbb3-41ec-bef8-96cebc72ab98 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.093049 Nov 08 18:11:28.859148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1349/2696] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:28 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:29.874311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-692d1ac2-3aeb-45d2-85c5-c02c243ce566 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:29.874933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-692d1ac2-3aeb-45d2-85c5-c02c243ce566 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:29.881150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-692d1ac2-3aeb-45d2-85c5-c02c243ce566 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:29.881602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-692d1ac2-3aeb-45d2-85c5-c02c243ce566 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:29.883410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-692d1ac2-3aeb-45d2-85c5-c02c243ce566 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:29.883849 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-692d1ac2-3aeb-45d2-85c5-c02c243ce566 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:29.941607 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-692d1ac2-3aeb-45d2-85c5-c02c243ce566 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:29.949800 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-692d1ac2-3aeb-45d2-85c5-c02c243ce566 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079199 Nov 08 18:11:29.950359 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1348/2697] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:30.966077 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b6463239-ea35-41f1-8809-059cd7a07839 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:30.966730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-b6463239-ea35-41f1-8809-059cd7a07839 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:30.973163 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6463239-ea35-41f1-8809-059cd7a07839 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:30.973609 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6463239-ea35-41f1-8809-059cd7a07839 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:30.974377 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6463239-ea35-41f1-8809-059cd7a07839 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:30.974833 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-b6463239-ea35-41f1-8809-059cd7a07839 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:31.035993 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-b6463239-ea35-41f1-8809-059cd7a07839 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:31.044056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b6463239-ea35-41f1-8809-059cd7a07839 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081657 Nov 08 18:11:31.044625 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1350/2698] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:32.060291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f4875f9f-9d37-4abc-bca9-eb8eda164ed7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:32.060902 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f4875f9f-9d37-4abc-bca9-eb8eda164ed7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:32.067332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4875f9f-9d37-4abc-bca9-eb8eda164ed7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:32.067778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4875f9f-9d37-4abc-bca9-eb8eda164ed7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:32.068554 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4875f9f-9d37-4abc-bca9-eb8eda164ed7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:32.069051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f4875f9f-9d37-4abc-bca9-eb8eda164ed7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:32.129497 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f4875f9f-9d37-4abc-bca9-eb8eda164ed7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:32.138016 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f4875f9f-9d37-4abc-bca9-eb8eda164ed7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081450 Nov 08 18:11:32.147321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1349/2699] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:32.351793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:11:32.352025 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:11:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:11:33.154354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-07ab41e7-9c58-4b20-8e47-78889e43e0a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:33.154978 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-07ab41e7-9c58-4b20-8e47-78889e43e0a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:33.161219 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07ab41e7-9c58-4b20-8e47-78889e43e0a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:33.161691 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07ab41e7-9c58-4b20-8e47-78889e43e0a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:33.162452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07ab41e7-9c58-4b20-8e47-78889e43e0a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:33.162908 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-07ab41e7-9c58-4b20-8e47-78889e43e0a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:33.224631 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-07ab41e7-9c58-4b20-8e47-78889e43e0a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:33.233069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-07ab41e7-9c58-4b20-8e47-78889e43e0a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082393 Nov 08 18:11:33.233632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1351/2700] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:34.249558 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-466ae100-6a9d-4409-98cb-f36b79f34663 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:34.250078 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-466ae100-6a9d-4409-98cb-f36b79f34663 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:34.256337 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-466ae100-6a9d-4409-98cb-f36b79f34663 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:34.257280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-466ae100-6a9d-4409-98cb-f36b79f34663 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:34.258171 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-466ae100-6a9d-4409-98cb-f36b79f34663 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:34.258629 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-466ae100-6a9d-4409-98cb-f36b79f34663 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:34.317489 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-466ae100-6a9d-4409-98cb-f36b79f34663 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:34.325705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-466ae100-6a9d-4409-98cb-f36b79f34663 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079866 Nov 08 18:11:34.326262 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1350/2701] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:35.341523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-227f1b0a-9015-4036-bd72-1bc1d3ebff50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:35.342154 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-227f1b0a-9015-4036-bd72-1bc1d3ebff50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:35.348596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-227f1b0a-9015-4036-bd72-1bc1d3ebff50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:35.349038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-227f1b0a-9015-4036-bd72-1bc1d3ebff50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:35.349797 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-227f1b0a-9015-4036-bd72-1bc1d3ebff50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:35.350229 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-227f1b0a-9015-4036-bd72-1bc1d3ebff50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:35.407775 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-227f1b0a-9015-4036-bd72-1bc1d3ebff50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:35.415463 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-227f1b0a-9015-4036-bd72-1bc1d3ebff50 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077584 Nov 08 18:11:35.416019 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1352/2702] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:36.431288 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-6527b5f0-62f5-4f88-9aad-f5e1af28b177 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:36.431896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-6527b5f0-62f5-4f88-9aad-f5e1af28b177 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:36.438125 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6527b5f0-62f5-4f88-9aad-f5e1af28b177 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:36.438611 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6527b5f0-62f5-4f88-9aad-f5e1af28b177 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:36.439379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6527b5f0-62f5-4f88-9aad-f5e1af28b177 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:36.439817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-6527b5f0-62f5-4f88-9aad-f5e1af28b177 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:36.499637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-6527b5f0-62f5-4f88-9aad-f5e1af28b177 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:36.507916 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-6527b5f0-62f5-4f88-9aad-f5e1af28b177 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080750 Nov 08 18:11:36.508465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1351/2703] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:37.524223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e7488fe3-fcaa-47d5-b6cf-156d0312dbbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:37.524855 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e7488fe3-fcaa-47d5-b6cf-156d0312dbbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:37.531102 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7488fe3-fcaa-47d5-b6cf-156d0312dbbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:37.531548 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7488fe3-fcaa-47d5-b6cf-156d0312dbbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:37.532316 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7488fe3-fcaa-47d5-b6cf-156d0312dbbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:37.532749 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7488fe3-fcaa-47d5-b6cf-156d0312dbbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:37.591386 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e7488fe3-fcaa-47d5-b6cf-156d0312dbbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:37.599286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e7488fe3-fcaa-47d5-b6cf-156d0312dbbf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078772 Nov 08 18:11:37.599849 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1353/2704] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:38.617051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b487ac14-9829-4e68-8b9c-6cc82df04658 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:38.617669 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b487ac14-9829-4e68-8b9c-6cc82df04658 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:38.623798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b487ac14-9829-4e68-8b9c-6cc82df04658 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:38.624233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b487ac14-9829-4e68-8b9c-6cc82df04658 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:38.624985 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b487ac14-9829-4e68-8b9c-6cc82df04658 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:38.625409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b487ac14-9829-4e68-8b9c-6cc82df04658 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:38.683513 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b487ac14-9829-4e68-8b9c-6cc82df04658 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:38.691004 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b487ac14-9829-4e68-8b9c-6cc82df04658 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078122 Nov 08 18:11:38.691557 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1352/2705] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:39.707294 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-bc001db9-5c9e-4a31-a0a7-8867075df2c0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:39.707897 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-bc001db9-5c9e-4a31-a0a7-8867075df2c0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:39.714258 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc001db9-5c9e-4a31-a0a7-8867075df2c0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:39.714738 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc001db9-5c9e-4a31-a0a7-8867075df2c0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:39.715495 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc001db9-5c9e-4a31-a0a7-8867075df2c0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:39.715930 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-bc001db9-5c9e-4a31-a0a7-8867075df2c0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:39.777067 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-bc001db9-5c9e-4a31-a0a7-8867075df2c0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:39.784892 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-bc001db9-5c9e-4a31-a0a7-8867075df2c0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081219 Nov 08 18:11:39.785452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1354/2706] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:40.801737 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-625d716b-146e-41a6-a597-1fc0f408eeee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:40.802330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-625d716b-146e-41a6-a597-1fc0f408eeee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:40.809167 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-625d716b-146e-41a6-a597-1fc0f408eeee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:40.809610 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-625d716b-146e-41a6-a597-1fc0f408eeee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:40.810362 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-625d716b-146e-41a6-a597-1fc0f408eeee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:40.810813 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-625d716b-146e-41a6-a597-1fc0f408eeee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:40.871329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-625d716b-146e-41a6-a597-1fc0f408eeee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:40.878790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-625d716b-146e-41a6-a597-1fc0f408eeee tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080640 Nov 08 18:11:40.879345 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1353/2707] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:40 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:41.895255 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d0c800d0-be35-45d9-b8d7-ea8a89b2b988 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:41.895890 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d0c800d0-be35-45d9-b8d7-ea8a89b2b988 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:41.902536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0c800d0-be35-45d9-b8d7-ea8a89b2b988 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:41.902983 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0c800d0-be35-45d9-b8d7-ea8a89b2b988 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:41.903746 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0c800d0-be35-45d9-b8d7-ea8a89b2b988 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:41.904177 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d0c800d0-be35-45d9-b8d7-ea8a89b2b988 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:41.961879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d0c800d0-be35-45d9-b8d7-ea8a89b2b988 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:41.969750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d0c800d0-be35-45d9-b8d7-ea8a89b2b988 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078239 Nov 08 18:11:41.970628 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1355/2708] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:42.986333 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5c66032b-ea95-411a-8858-b2ca9f8b0b05 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:42.986971 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5c66032b-ea95-411a-8858-b2ca9f8b0b05 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:42.993051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c66032b-ea95-411a-8858-b2ca9f8b0b05 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:42.993487 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c66032b-ea95-411a-8858-b2ca9f8b0b05 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:42.994251 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c66032b-ea95-411a-8858-b2ca9f8b0b05 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:42.994709 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5c66032b-ea95-411a-8858-b2ca9f8b0b05 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:43.053148 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5c66032b-ea95-411a-8858-b2ca9f8b0b05 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:43.060793 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5c66032b-ea95-411a-8858-b2ca9f8b0b05 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078107 Nov 08 18:11:43.061351 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1354/2709] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:11:44.077060 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-740f2c87-95d5-44f5-b667-a03be8df78ce tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:44.077671 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-740f2c87-95d5-44f5-b667-a03be8df78ce tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:44.083881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-740f2c87-95d5-44f5-b667-a03be8df78ce tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:44.084327 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-740f2c87-95d5-44f5-b667-a03be8df78ce tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:44.085090 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-740f2c87-95d5-44f5-b667-a03be8df78ce tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:44.085532 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-740f2c87-95d5-44f5-b667-a03be8df78ce tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:44.145986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-740f2c87-95d5-44f5-b667-a03be8df78ce tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:44.154004 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-740f2c87-95d5-44f5-b667-a03be8df78ce tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080624 Nov 08 18:11:44.154588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1356/2710] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:45.170824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5348b370-b43f-41bb-8383-1ef99bfd14a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:45.171423 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5348b370-b43f-41bb-8383-1ef99bfd14a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:45.177836 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5348b370-b43f-41bb-8383-1ef99bfd14a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:45.178299 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5348b370-b43f-41bb-8383-1ef99bfd14a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:45.179141 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5348b370-b43f-41bb-8383-1ef99bfd14a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:45.179671 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5348b370-b43f-41bb-8383-1ef99bfd14a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:45.237474 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5348b370-b43f-41bb-8383-1ef99bfd14a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:45.245200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5348b370-b43f-41bb-8383-1ef99bfd14a2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077948 Nov 08 18:11:45.245687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1355/2711] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:46.261452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-0e42cbb6-3887-4565-b266-97b3899ade72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:46.262024 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-0e42cbb6-3887-4565-b266-97b3899ade72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:46.268250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e42cbb6-3887-4565-b266-97b3899ade72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:46.268687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e42cbb6-3887-4565-b266-97b3899ade72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:46.269446 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e42cbb6-3887-4565-b266-97b3899ade72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:46.269879 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-0e42cbb6-3887-4565-b266-97b3899ade72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:46.331568 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-0e42cbb6-3887-4565-b266-97b3899ade72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:46.339933 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-0e42cbb6-3887-4565-b266-97b3899ade72 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082769 Nov 08 18:11:46.340493 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1357/2712] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:47.356477 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-fe69cd7c-770c-4472-b9ed-5198fdba11b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:47.357102 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-fe69cd7c-770c-4472-b9ed-5198fdba11b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:47.363257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe69cd7c-770c-4472-b9ed-5198fdba11b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:47.363692 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe69cd7c-770c-4472-b9ed-5198fdba11b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:47.364448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe69cd7c-770c-4472-b9ed-5198fdba11b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:47.364876 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-fe69cd7c-770c-4472-b9ed-5198fdba11b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:47.423164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-fe69cd7c-770c-4472-b9ed-5198fdba11b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:47.430687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-fe69cd7c-770c-4472-b9ed-5198fdba11b9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077849 Nov 08 18:11:47.431857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1356/2713] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:48.448189 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e87209f4-8126-49cf-ab2a-307a39842e4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:48.448779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e87209f4-8126-49cf-ab2a-307a39842e4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:48.455038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e87209f4-8126-49cf-ab2a-307a39842e4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:48.455483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e87209f4-8126-49cf-ab2a-307a39842e4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:48.456266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e87209f4-8126-49cf-ab2a-307a39842e4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:48.456694 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e87209f4-8126-49cf-ab2a-307a39842e4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:48.516588 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e87209f4-8126-49cf-ab2a-307a39842e4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:48.524146 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e87209f4-8126-49cf-ab2a-307a39842e4f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079677 Nov 08 18:11:48.524701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1358/2714] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:49.540427 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ee4e2f91-d0dd-47bc-a448-f218f185cffb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:49.540987 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ee4e2f91-d0dd-47bc-a448-f218f185cffb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:49.548285 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee4e2f91-d0dd-47bc-a448-f218f185cffb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:49.548733 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee4e2f91-d0dd-47bc-a448-f218f185cffb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:49.549491 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee4e2f91-d0dd-47bc-a448-f218f185cffb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:49.549919 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ee4e2f91-d0dd-47bc-a448-f218f185cffb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:49.607938 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ee4e2f91-d0dd-47bc-a448-f218f185cffb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:49.615476 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ee4e2f91-d0dd-47bc-a448-f218f185cffb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078741 Nov 08 18:11:49.616032 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1357/2715] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:50.631696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-44e51f58-7a03-462d-a6ad-217581b2fdcb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:50.632308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-44e51f58-7a03-462d-a6ad-217581b2fdcb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:50.638801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-44e51f58-7a03-462d-a6ad-217581b2fdcb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:50.639251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-44e51f58-7a03-462d-a6ad-217581b2fdcb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:50.640020 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-44e51f58-7a03-462d-a6ad-217581b2fdcb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:50.640458 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-44e51f58-7a03-462d-a6ad-217581b2fdcb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:50.699651 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-44e51f58-7a03-462d-a6ad-217581b2fdcb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:50.707227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-44e51f58-7a03-462d-a6ad-217581b2fdcb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079200 Nov 08 18:11:50.707785 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1359/2716] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:51.724155 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8aa9f864-4f5c-4ef4-8c11-da57493cb31b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:51.724762 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8aa9f864-4f5c-4ef4-8c11-da57493cb31b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:51.731111 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8aa9f864-4f5c-4ef4-8c11-da57493cb31b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:51.731551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8aa9f864-4f5c-4ef4-8c11-da57493cb31b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:51.732316 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8aa9f864-4f5c-4ef4-8c11-da57493cb31b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:51.732748 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8aa9f864-4f5c-4ef4-8c11-da57493cb31b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:51.791382 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8aa9f864-4f5c-4ef4-8c11-da57493cb31b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:51.799098 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8aa9f864-4f5c-4ef4-8c11-da57493cb31b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078680 Nov 08 18:11:51.799657 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1358/2717] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:52.815933 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e2e95f10-de04-4a1a-8175-26a84694d9c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:52.816573 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e2e95f10-de04-4a1a-8175-26a84694d9c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:52.823366 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2e95f10-de04-4a1a-8175-26a84694d9c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:52.823997 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2e95f10-de04-4a1a-8175-26a84694d9c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:52.824768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2e95f10-de04-4a1a-8175-26a84694d9c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:52.825203 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e2e95f10-de04-4a1a-8175-26a84694d9c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:52.887052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e2e95f10-de04-4a1a-8175-26a84694d9c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:52.894802 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e2e95f10-de04-4a1a-8175-26a84694d9c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082576 Nov 08 18:11:52.895370 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1360/2718] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:52 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:53.911889 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-dddf2909-0644-4a0a-85d9-7380628d2df8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:53.912488 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-dddf2909-0644-4a0a-85d9-7380628d2df8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:53.919291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dddf2909-0644-4a0a-85d9-7380628d2df8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:53.919725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dddf2909-0644-4a0a-85d9-7380628d2df8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:53.920480 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dddf2909-0644-4a0a-85d9-7380628d2df8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:53.920908 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-dddf2909-0644-4a0a-85d9-7380628d2df8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:53.980475 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-dddf2909-0644-4a0a-85d9-7380628d2df8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:53.988121 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-dddf2909-0644-4a0a-85d9-7380628d2df8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079935 Nov 08 18:11:53.988686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1359/2719] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:55.003923 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6bcd6a15-0d2c-40a0-aea6-5bd3d0bfea25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:55.004537 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6bcd6a15-0d2c-40a0-aea6-5bd3d0bfea25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:55.011502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bcd6a15-0d2c-40a0-aea6-5bd3d0bfea25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:55.011946 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bcd6a15-0d2c-40a0-aea6-5bd3d0bfea25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:55.012707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bcd6a15-0d2c-40a0-aea6-5bd3d0bfea25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:55.013140 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6bcd6a15-0d2c-40a0-aea6-5bd3d0bfea25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:55.071138 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6bcd6a15-0d2c-40a0-aea6-5bd3d0bfea25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:55.079460 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6bcd6a15-0d2c-40a0-aea6-5bd3d0bfea25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079222 Nov 08 18:11:55.080023 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1361/2720] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:56.095352 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-24ca11c2-9d3a-4c9b-9dff-d3906d6eec57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:56.095976 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-24ca11c2-9d3a-4c9b-9dff-d3906d6eec57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:56.102159 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24ca11c2-9d3a-4c9b-9dff-d3906d6eec57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:56.102634 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24ca11c2-9d3a-4c9b-9dff-d3906d6eec57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:56.103393 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24ca11c2-9d3a-4c9b-9dff-d3906d6eec57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:56.103893 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-24ca11c2-9d3a-4c9b-9dff-d3906d6eec57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:56.162083 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-24ca11c2-9d3a-4c9b-9dff-d3906d6eec57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:56.170110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-24ca11c2-9d3a-4c9b-9dff-d3906d6eec57 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078618 Nov 08 18:11:56.170688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1360/2721] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:57.187038 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f025157a-157c-440d-8e7f-fbd15bfd8be1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:57.187657 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f025157a-157c-440d-8e7f-fbd15bfd8be1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:57.193896 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f025157a-157c-440d-8e7f-fbd15bfd8be1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:57.194344 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f025157a-157c-440d-8e7f-fbd15bfd8be1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:57.195148 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f025157a-157c-440d-8e7f-fbd15bfd8be1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:57.195584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f025157a-157c-440d-8e7f-fbd15bfd8be1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:57.254982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f025157a-157c-440d-8e7f-fbd15bfd8be1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:57.263165 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f025157a-157c-440d-8e7f-fbd15bfd8be1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079756 Nov 08 18:11:57.263733 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1362/2722] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:58.278729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f125532d-27d0-4125-8ca4-cc51dddd9afc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:58.279259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f125532d-27d0-4125-8ca4-cc51dddd9afc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:58.285604 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f125532d-27d0-4125-8ca4-cc51dddd9afc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:58.286053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f125532d-27d0-4125-8ca4-cc51dddd9afc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:58.286846 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f125532d-27d0-4125-8ca4-cc51dddd9afc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:58.287280 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f125532d-27d0-4125-8ca4-cc51dddd9afc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:58.346042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f125532d-27d0-4125-8ca4-cc51dddd9afc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:58.353644 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f125532d-27d0-4125-8ca4-cc51dddd9afc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078709 Nov 08 18:11:58.354722 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1361/2723] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:11:59.370697 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a4a201b9-69d4-4ff7-924c-658d663b2ee4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:11:59.371300 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a4a201b9-69d4-4ff7-924c-658d663b2ee4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:11:59.377441 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4a201b9-69d4-4ff7-924c-658d663b2ee4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:59.377883 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4a201b9-69d4-4ff7-924c-658d663b2ee4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:59.378673 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4a201b9-69d4-4ff7-924c-658d663b2ee4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:11:59.379104 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a4a201b9-69d4-4ff7-924c-658d663b2ee4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:11:59.439391 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a4a201b9-69d4-4ff7-924c-658d663b2ee4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:11:59.447420 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a4a201b9-69d4-4ff7-924c-658d663b2ee4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080539 Nov 08 18:11:59.447986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1363/2724] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:11:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:00.463562 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-104bc199-c240-4534-8669-3fb161a18045 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:00.464166 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-104bc199-c240-4534-8669-3fb161a18045 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:00.470672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-104bc199-c240-4534-8669-3fb161a18045 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:00.471114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-104bc199-c240-4534-8669-3fb161a18045 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:00.471873 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-104bc199-c240-4534-8669-3fb161a18045 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:00.472296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-104bc199-c240-4534-8669-3fb161a18045 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:00.531040 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-104bc199-c240-4534-8669-3fb161a18045 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:00.538571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-104bc199-c240-4534-8669-3fb161a18045 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078702 Nov 08 18:12:00.539124 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1362/2725] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:01.555720 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-638b931c-0de1-4b45-9e8e-90f0776f1b9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:01.556318 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-638b931c-0de1-4b45-9e8e-90f0776f1b9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:01.562586 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-638b931c-0de1-4b45-9e8e-90f0776f1b9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:01.563025 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-638b931c-0de1-4b45-9e8e-90f0776f1b9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:01.563780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-638b931c-0de1-4b45-9e8e-90f0776f1b9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:01.564206 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-638b931c-0de1-4b45-9e8e-90f0776f1b9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:01.624373 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-638b931c-0de1-4b45-9e8e-90f0776f1b9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:01.631982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-638b931c-0de1-4b45-9e8e-90f0776f1b9c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079884 Nov 08 18:12:01.632881 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1364/2726] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:01 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:02.648913 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-541eab6a-b278-4f35-9706-ed312445cc30 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:02.649538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-541eab6a-b278-4f35-9706-ed312445cc30 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:02.655772 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-541eab6a-b278-4f35-9706-ed312445cc30 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:02.656215 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-541eab6a-b278-4f35-9706-ed312445cc30 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:02.656972 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-541eab6a-b278-4f35-9706-ed312445cc30 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:02.657405 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-541eab6a-b278-4f35-9706-ed312445cc30 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:02.715414 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-541eab6a-b278-4f35-9706-ed312445cc30 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:02.723199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-541eab6a-b278-4f35-9706-ed312445cc30 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078001 Nov 08 18:12:02.723752 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1363/2727] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:03.740268 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f1e1ffd0-3c83-484b-9f21-f8a4a6d335b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:03.740874 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f1e1ffd0-3c83-484b-9f21-f8a4a6d335b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:03.747616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffd0-3c83-484b-9f21-f8a4a6d335b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:03.752126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffd0-3c83-484b-9f21-f8a4a6d335b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:03.752126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffd0-3c83-484b-9f21-f8a4a6d335b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:03.752126 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f1e1ffd0-3c83-484b-9f21-f8a4a6d335b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:03.809701 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f1e1ffd0-3c83-484b-9f21-f8a4a6d335b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:03.817354 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f1e1ffd0-3c83-484b-9f21-f8a4a6d335b2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080780 Nov 08 18:12:03.817901 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1365/2728] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:04.834158 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ea591189-de05-4ef8-b859-bee1507cbc5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:04.834776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ea591189-de05-4ef8-b859-bee1507cbc5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:04.841688 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea591189-de05-4ef8-b859-bee1507cbc5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:04.842120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea591189-de05-4ef8-b859-bee1507cbc5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:04.843144 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea591189-de05-4ef8-b859-bee1507cbc5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:04.843582 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ea591189-de05-4ef8-b859-bee1507cbc5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:04.903293 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ea591189-de05-4ef8-b859-bee1507cbc5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:04.911257 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ea591189-de05-4ef8-b859-bee1507cbc5c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080775 Nov 08 18:12:04.911824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1364/2729] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:05.928152 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-aced8301-cfdc-48f5-804e-2e960b9d5314 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:05.928750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-aced8301-cfdc-48f5-804e-2e960b9d5314 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:05.935623 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aced8301-cfdc-48f5-804e-2e960b9d5314 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:05.936085 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aced8301-cfdc-48f5-804e-2e960b9d5314 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:05.936819 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aced8301-cfdc-48f5-804e-2e960b9d5314 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:05.937252 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-aced8301-cfdc-48f5-804e-2e960b9d5314 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:06.001331 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-aced8301-cfdc-48f5-804e-2e960b9d5314 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:06.009596 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-aced8301-cfdc-48f5-804e-2e960b9d5314 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.084977 Nov 08 18:12:06.009894 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1366/2730] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:07.025653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b66a328b-fe04-4c38-8883-03e96ee0081a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:07.026410 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b66a328b-fe04-4c38-8883-03e96ee0081a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:07.032714 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b66a328b-fe04-4c38-8883-03e96ee0081a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:07.033161 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b66a328b-fe04-4c38-8883-03e96ee0081a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:07.033923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b66a328b-fe04-4c38-8883-03e96ee0081a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:07.034355 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b66a328b-fe04-4c38-8883-03e96ee0081a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:07.092175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b66a328b-fe04-4c38-8883-03e96ee0081a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:07.099857 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b66a328b-fe04-4c38-8883-03e96ee0081a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077897 Nov 08 18:12:07.100412 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1365/2731] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:08.118055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e341e334-517a-4e69-b75e-08f8c5acf5c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:08.118763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e341e334-517a-4e69-b75e-08f8c5acf5c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:08.125073 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e341e334-517a-4e69-b75e-08f8c5acf5c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:08.125520 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e341e334-517a-4e69-b75e-08f8c5acf5c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:08.126288 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e341e334-517a-4e69-b75e-08f8c5acf5c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:08.126750 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e341e334-517a-4e69-b75e-08f8c5acf5c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:08.184952 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e341e334-517a-4e69-b75e-08f8c5acf5c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:08.192507 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e341e334-517a-4e69-b75e-08f8c5acf5c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078107 Nov 08 18:12:08.193064 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1367/2732] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:09.208576 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-da0334d7-7a9a-4e91-b758-b23659c1374b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:09.209163 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-da0334d7-7a9a-4e91-b758-b23659c1374b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:09.216302 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da0334d7-7a9a-4e91-b758-b23659c1374b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:09.216747 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da0334d7-7a9a-4e91-b758-b23659c1374b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:09.217512 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da0334d7-7a9a-4e91-b758-b23659c1374b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:09.218200 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-da0334d7-7a9a-4e91-b758-b23659c1374b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:09.276466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-da0334d7-7a9a-4e91-b758-b23659c1374b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:09.284143 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-da0334d7-7a9a-4e91-b758-b23659c1374b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079381 Nov 08 18:12:09.284699 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1366/2733] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:10.300773 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-36fc4540-bd0d-4c14-929e-c50502e2bbdf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:10.301332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-36fc4540-bd0d-4c14-929e-c50502e2bbdf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:10.308381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36fc4540-bd0d-4c14-929e-c50502e2bbdf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:10.308834 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36fc4540-bd0d-4c14-929e-c50502e2bbdf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:10.309606 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36fc4540-bd0d-4c14-929e-c50502e2bbdf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:10.310044 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-36fc4540-bd0d-4c14-929e-c50502e2bbdf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:10.368696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-36fc4540-bd0d-4c14-929e-c50502e2bbdf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:10.376996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-36fc4540-bd0d-4c14-929e-c50502e2bbdf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080105 Nov 08 18:12:10.377569 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1368/2734] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:11.397867 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5f8d11be-61a8-4557-93b5-9a08bbb88b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:11.398615 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5f8d11be-61a8-4557-93b5-9a08bbb88b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:11.404911 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f8d11be-61a8-4557-93b5-9a08bbb88b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:11.405353 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f8d11be-61a8-4557-93b5-9a08bbb88b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:11.406119 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f8d11be-61a8-4557-93b5-9a08bbb88b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:11.406570 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5f8d11be-61a8-4557-93b5-9a08bbb88b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:11.465412 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5f8d11be-61a8-4557-93b5-9a08bbb88b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:11.473273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5f8d11be-61a8-4557-93b5-9a08bbb88b5a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079007 Nov 08 18:12:11.473819 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1367/2735] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:12.491134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-3e8c4111-baef-4bbc-8f66-ee1e5d2048c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:12.491763 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-3e8c4111-baef-4bbc-8f66-ee1e5d2048c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:12.497591 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e8c4111-baef-4bbc-8f66-ee1e5d2048c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:12.498043 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e8c4111-baef-4bbc-8f66-ee1e5d2048c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:12.498849 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e8c4111-baef-4bbc-8f66-ee1e5d2048c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:12.499290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-3e8c4111-baef-4bbc-8f66-ee1e5d2048c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:12.560169 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-3e8c4111-baef-4bbc-8f66-ee1e5d2048c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:12.568911 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-3e8c4111-baef-4bbc-8f66-ee1e5d2048c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081635 Nov 08 18:12:12.569474 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1369/2736] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:13.585990 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b8b524e3-d9fd-41b5-bcc9-7046e41e7927 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:13.586564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-b8b524e3-d9fd-41b5-bcc9-7046e41e7927 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:13.593116 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b8b524e3-d9fd-41b5-bcc9-7046e41e7927 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:13.593561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b8b524e3-d9fd-41b5-bcc9-7046e41e7927 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:13.594323 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b8b524e3-d9fd-41b5-bcc9-7046e41e7927 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:13.594778 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-b8b524e3-d9fd-41b5-bcc9-7046e41e7927 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:13.655419 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-b8b524e3-d9fd-41b5-bcc9-7046e41e7927 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:13.663130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b8b524e3-d9fd-41b5-bcc9-7046e41e7927 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081041 Nov 08 18:12:13.663687 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1368/2737] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:13 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:14.680119 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-175dad16-fe6b-4cee-a091-c4ab658aa45c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:14.680717 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-175dad16-fe6b-4cee-a091-c4ab658aa45c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:14.687839 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-175dad16-fe6b-4cee-a091-c4ab658aa45c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:14.688286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-175dad16-fe6b-4cee-a091-c4ab658aa45c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:14.689052 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-175dad16-fe6b-4cee-a091-c4ab658aa45c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:14.689487 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-175dad16-fe6b-4cee-a091-c4ab658aa45c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:14.748222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-175dad16-fe6b-4cee-a091-c4ab658aa45c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:14.755965 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-175dad16-fe6b-4cee-a091-c4ab658aa45c tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079568 Nov 08 18:12:14.759422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1370/2738] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:15.772879 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-5d80020b-17c8-41a4-8ec0-4a1a8d7272ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:15.773542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-5d80020b-17c8-41a4-8ec0-4a1a8d7272ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:15.779787 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d80020b-17c8-41a4-8ec0-4a1a8d7272ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:15.780230 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d80020b-17c8-41a4-8ec0-4a1a8d7272ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:15.780996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d80020b-17c8-41a4-8ec0-4a1a8d7272ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:15.781430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-5d80020b-17c8-41a4-8ec0-4a1a8d7272ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:15.999380 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-5d80020b-17c8-41a4-8ec0-4a1a8d7272ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:16.007027 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-5d80020b-17c8-41a4-8ec0-4a1a8d7272ed tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.237908 Nov 08 18:12:16.007575 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1369/2739] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:17.024001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-74ca0c34-9472-40cf-9d8a-e9b7342731ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:17.024621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-74ca0c34-9472-40cf-9d8a-e9b7342731ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:17.031259 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74ca0c34-9472-40cf-9d8a-e9b7342731ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:17.031705 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74ca0c34-9472-40cf-9d8a-e9b7342731ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:17.032476 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74ca0c34-9472-40cf-9d8a-e9b7342731ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:17.032909 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-74ca0c34-9472-40cf-9d8a-e9b7342731ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:17.091297 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-74ca0c34-9472-40cf-9d8a-e9b7342731ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:17.099110 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-74ca0c34-9472-40cf-9d8a-e9b7342731ab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078815 Nov 08 18:12:17.099669 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1371/2740] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:18.115707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8972510f-2369-467e-8b48-ea63650fa159 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:18.116305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8972510f-2369-467e-8b48-ea63650fa159 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:18.122927 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8972510f-2369-467e-8b48-ea63650fa159 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:18.123365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8972510f-2369-467e-8b48-ea63650fa159 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:18.124123 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8972510f-2369-467e-8b48-ea63650fa159 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:18.124550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8972510f-2369-467e-8b48-ea63650fa159 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:18.181054 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8972510f-2369-467e-8b48-ea63650fa159 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:18.188968 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8972510f-2369-467e-8b48-ea63650fa159 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.076868 Nov 08 18:12:18.189511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1370/2741] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:19.205251 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-70c7f9a4-f0c7-4265-9213-d96f163d16f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:19.205855 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-70c7f9a4-f0c7-4265-9213-d96f163d16f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:19.212055 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-70c7f9a4-f0c7-4265-9213-d96f163d16f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:19.212496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-70c7f9a4-f0c7-4265-9213-d96f163d16f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:19.213250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-70c7f9a4-f0c7-4265-9213-d96f163d16f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:19.213681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-70c7f9a4-f0c7-4265-9213-d96f163d16f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:19.274888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-70c7f9a4-f0c7-4265-9213-d96f163d16f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:19.283431 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-70c7f9a4-f0c7-4265-9213-d96f163d16f9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081824 Nov 08 18:12:19.283986 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1372/2742] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:19 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:20.299686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a598e472-a1cd-4ec9-9095-214bd917dbe2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:20.300231 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a598e472-a1cd-4ec9-9095-214bd917dbe2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:20.306612 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a598e472-a1cd-4ec9-9095-214bd917dbe2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:20.307061 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a598e472-a1cd-4ec9-9095-214bd917dbe2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:20.308379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a598e472-a1cd-4ec9-9095-214bd917dbe2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:20.308817 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a598e472-a1cd-4ec9-9095-214bd917dbe2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:20.366292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a598e472-a1cd-4ec9-9095-214bd917dbe2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:20.374430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a598e472-a1cd-4ec9-9095-214bd917dbe2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078461 Nov 08 18:12:20.377917 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1371/2743] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:20 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:21.390608 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7dacb143-52e9-4a17-b856-3c6b00b3ef76 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:21.391233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7dacb143-52e9-4a17-b856-3c6b00b3ef76 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:21.397473 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7dacb143-52e9-4a17-b856-3c6b00b3ef76 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:21.397919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7dacb143-52e9-4a17-b856-3c6b00b3ef76 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:21.398719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7dacb143-52e9-4a17-b856-3c6b00b3ef76 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:21.399161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7dacb143-52e9-4a17-b856-3c6b00b3ef76 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:21.459962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7dacb143-52e9-4a17-b856-3c6b00b3ef76 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:21.468616 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7dacb143-52e9-4a17-b856-3c6b00b3ef76 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081664 Nov 08 18:12:21.476030 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1373/2744] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:21 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:22.485091 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1474d7d4-aa53-495b-8dd6-3570149270c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:22.485696 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1474d7d4-aa53-495b-8dd6-3570149270c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:22.492150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1474d7d4-aa53-495b-8dd6-3570149270c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:22.492620 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1474d7d4-aa53-495b-8dd6-3570149270c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:22.493448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1474d7d4-aa53-495b-8dd6-3570149270c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:22.493875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1474d7d4-aa53-495b-8dd6-3570149270c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:22.553216 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1474d7d4-aa53-495b-8dd6-3570149270c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:22.560881 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1474d7d4-aa53-495b-8dd6-3570149270c9 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079458 Nov 08 18:12:22.561418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1372/2745] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:22 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:23.577076 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-01569fd3-f29f-4a69-9de9-c1e984c20047 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:23.577647 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-01569fd3-f29f-4a69-9de9-c1e984c20047 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:23.583846 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-01569fd3-f29f-4a69-9de9-c1e984c20047 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:23.584319 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-01569fd3-f29f-4a69-9de9-c1e984c20047 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:23.585087 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-01569fd3-f29f-4a69-9de9-c1e984c20047 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:23.585521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-01569fd3-f29f-4a69-9de9-c1e984c20047 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:23.644078 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-01569fd3-f29f-4a69-9de9-c1e984c20047 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:23.651818 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-01569fd3-f29f-4a69-9de9-c1e984c20047 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078705 Nov 08 18:12:23.652372 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1374/2746] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:23 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:24.668058 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-86e3b512-2214-4f0a-9a0a-95854f359ff0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:24.668660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-86e3b512-2214-4f0a-9a0a-95854f359ff0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:24.674811 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86e3b512-2214-4f0a-9a0a-95854f359ff0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:24.675252 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86e3b512-2214-4f0a-9a0a-95854f359ff0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:24.676011 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86e3b512-2214-4f0a-9a0a-95854f359ff0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:24.676440 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-86e3b512-2214-4f0a-9a0a-95854f359ff0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:24.734532 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-86e3b512-2214-4f0a-9a0a-95854f359ff0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:24.742000 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-86e3b512-2214-4f0a-9a0a-95854f359ff0 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077601 Nov 08 18:12:24.742564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1373/2747] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:24 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:25.758736 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4705c0ab-71c2-4d20-914b-6335c17cad3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:25.759451 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-4705c0ab-71c2-4d20-914b-6335c17cad3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:25.765515 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4705c0ab-71c2-4d20-914b-6335c17cad3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:25.765962 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4705c0ab-71c2-4d20-914b-6335c17cad3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:25.766756 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4705c0ab-71c2-4d20-914b-6335c17cad3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:25.767193 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-4705c0ab-71c2-4d20-914b-6335c17cad3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:25.830153 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-4705c0ab-71c2-4d20-914b-6335c17cad3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:25.838107 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4705c0ab-71c2-4d20-914b-6335c17cad3b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.083198 Nov 08 18:12:25.839389 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1375/2748] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:25 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:26.855568 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f9bc3162-7751-4890-9273-b4c5cace80da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:26.856201 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f9bc3162-7751-4890-9273-b4c5cace80da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:26.862326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9bc3162-7751-4890-9273-b4c5cace80da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:26.862802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9bc3162-7751-4890-9273-b4c5cace80da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:26.863564 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9bc3162-7751-4890-9273-b4c5cace80da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:26.863993 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f9bc3162-7751-4890-9273-b4c5cace80da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:26.922437 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f9bc3162-7751-4890-9273-b4c5cace80da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:26.930296 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f9bc3162-7751-4890-9273-b4c5cace80da tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078902 Nov 08 18:12:26.930877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1374/2749] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:26 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:27.946535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-ab3ead4c-7871-4e6f-87ac-36ff9e1e7119 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:27.947132 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-ab3ead4c-7871-4e6f-87ac-36ff9e1e7119 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:27.954135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ab3ead4c-7871-4e6f-87ac-36ff9e1e7119 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:27.954614 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ab3ead4c-7871-4e6f-87ac-36ff9e1e7119 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:27.955376 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ab3ead4c-7871-4e6f-87ac-36ff9e1e7119 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:27.955806 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-ab3ead4c-7871-4e6f-87ac-36ff9e1e7119 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:28.014707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-ab3ead4c-7871-4e6f-87ac-36ff9e1e7119 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:28.022422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-ab3ead4c-7871-4e6f-87ac-36ff9e1e7119 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079643 Nov 08 18:12:28.023014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1376/2750] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:27 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:29.039199 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8c2e58d4-3c12-43df-a93c-8c21dec06c1b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:29.039803 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-8c2e58d4-3c12-43df-a93c-8c21dec06c1b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:29.046450 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c2e58d4-3c12-43df-a93c-8c21dec06c1b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:29.046923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c2e58d4-3c12-43df-a93c-8c21dec06c1b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:29.047686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c2e58d4-3c12-43df-a93c-8c21dec06c1b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:29.048120 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-8c2e58d4-3c12-43df-a93c-8c21dec06c1b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:29.107707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-8c2e58d4-3c12-43df-a93c-8c21dec06c1b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:29.115291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8c2e58d4-3c12-43df-a93c-8c21dec06c1b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080044 Nov 08 18:12:29.115838 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1375/2751] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:29 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:30.131505 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a534e8eb-0bbc-401c-9f59-b6a1a1687483 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:30.132101 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a534e8eb-0bbc-401c-9f59-b6a1a1687483 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:30.138455 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a534e8eb-0bbc-401c-9f59-b6a1a1687483 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:30.138931 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a534e8eb-0bbc-401c-9f59-b6a1a1687483 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:30.139696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a534e8eb-0bbc-401c-9f59-b6a1a1687483 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:30.140133 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a534e8eb-0bbc-401c-9f59-b6a1a1687483 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:30.197502 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-a534e8eb-0bbc-401c-9f59-b6a1a1687483 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:30.205398 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a534e8eb-0bbc-401c-9f59-b6a1a1687483 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077574 Nov 08 18:12:30.205954 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1377/2752] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:30 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:31.229048 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-58c48085-06d7-4826-8178-1d50da7fd1e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:31.230332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-58c48085-06d7-4826-8178-1d50da7fd1e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:31.236767 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-58c48085-06d7-4826-8178-1d50da7fd1e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:31.237211 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-58c48085-06d7-4826-8178-1d50da7fd1e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:31.237969 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-58c48085-06d7-4826-8178-1d50da7fd1e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:31.238400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-58c48085-06d7-4826-8178-1d50da7fd1e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:31.296063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-58c48085-06d7-4826-8178-1d50da7fd1e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:31.303592 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-58c48085-06d7-4826-8178-1d50da7fd1e7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078189 Nov 08 18:12:31.304139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1376/2753] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:31 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:32.321290 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-2baade83-ffb4-41bd-9041-1cedaf88d0e3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:32.321835 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-2baade83-ffb4-41bd-9041-1cedaf88d0e3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:32.328788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2baade83-ffb4-41bd-9041-1cedaf88d0e3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:32.329236 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2baade83-ffb4-41bd-9041-1cedaf88d0e3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:32.330059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2baade83-ffb4-41bd-9041-1cedaf88d0e3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:32.330483 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-2baade83-ffb4-41bd-9041-1cedaf88d0e3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:32.393863 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-2baade83-ffb4-41bd-9041-1cedaf88d0e3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:32.402564 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-2baade83-ffb4-41bd-9041-1cedaf88d0e3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.085347 Nov 08 18:12:32.403141 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1378/2754] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:32 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:33.419328 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e25c3c75-501a-4d17-9ddc-b79da2042846 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:33.419929 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e25c3c75-501a-4d17-9ddc-b79da2042846 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:33.426190 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e25c3c75-501a-4d17-9ddc-b79da2042846 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:33.426668 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e25c3c75-501a-4d17-9ddc-b79da2042846 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:33.427430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e25c3c75-501a-4d17-9ddc-b79da2042846 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:33.427860 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e25c3c75-501a-4d17-9ddc-b79da2042846 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:33.487542 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e25c3c75-501a-4d17-9ddc-b79da2042846 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:33.495421 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e25c3c75-501a-4d17-9ddc-b79da2042846 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079801 Nov 08 18:12:33.496126 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1377/2755] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:33 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:34.512702 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f34c7662-1b33-46c6-a6c4-eb9d7bc4acab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:34.513315 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f34c7662-1b33-46c6-a6c4-eb9d7bc4acab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:34.519610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f34c7662-1b33-46c6-a6c4-eb9d7bc4acab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:34.520056 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f34c7662-1b33-46c6-a6c4-eb9d7bc4acab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:34.520824 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f34c7662-1b33-46c6-a6c4-eb9d7bc4acab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:34.521286 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f34c7662-1b33-46c6-a6c4-eb9d7bc4acab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:34.581594 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f34c7662-1b33-46c6-a6c4-eb9d7bc4acab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:34.589996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f34c7662-1b33-46c6-a6c4-eb9d7bc4acab tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081262 Nov 08 18:12:34.590575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1379/2756] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:34 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:35.606301 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3e833667-536d-4f8b-bcd2-fba533544d65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:35.606901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-3e833667-536d-4f8b-bcd2-fba533544d65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:35.613076 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e833667-536d-4f8b-bcd2-fba533544d65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:35.613523 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e833667-536d-4f8b-bcd2-fba533544d65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:35.614291 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e833667-536d-4f8b-bcd2-fba533544d65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:35.614755 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-3e833667-536d-4f8b-bcd2-fba533544d65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:35.672292 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-3e833667-536d-4f8b-bcd2-fba533544d65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:35.679888 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3e833667-536d-4f8b-bcd2-fba533544d65 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078045 Nov 08 18:12:35.680439 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1378/2757] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:35 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:36.696461 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-6f3f5a0a-bc27-4e3b-88f6-b15f30d86da4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:36.697049 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-6f3f5a0a-bc27-4e3b-88f6-b15f30d86da4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:36.703982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f3f5a0a-bc27-4e3b-88f6-b15f30d86da4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:36.704422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f3f5a0a-bc27-4e3b-88f6-b15f30d86da4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:36.705181 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f3f5a0a-bc27-4e3b-88f6-b15f30d86da4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:36.705627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-6f3f5a0a-bc27-4e3b-88f6-b15f30d86da4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:36.765404 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-6f3f5a0a-bc27-4e3b-88f6-b15f30d86da4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:36.773161 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-6f3f5a0a-bc27-4e3b-88f6-b15f30d86da4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080373 Nov 08 18:12:36.773711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1380/2758] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:36 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:37.789561 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-a511e304-468e-4e3d-95c2-ed9c27d227aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:37.790170 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-a511e304-468e-4e3d-95c2-ed9c27d227aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:37.797666 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a511e304-468e-4e3d-95c2-ed9c27d227aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:37.798107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a511e304-468e-4e3d-95c2-ed9c27d227aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:37.798905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a511e304-468e-4e3d-95c2-ed9c27d227aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:37.799332 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-a511e304-468e-4e3d-95c2-ed9c27d227aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:37.860901 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-a511e304-468e-4e3d-95c2-ed9c27d227aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:37.868593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-a511e304-468e-4e3d-95c2-ed9c27d227aa tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082676 Nov 08 18:12:37.869139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1379/2759] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:37 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:38.885124 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-91dcdac9-9e9f-47a4-aae9-f105802f1c25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:38.886581 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-91dcdac9-9e9f-47a4-aae9-f105802f1c25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:38.892813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91dcdac9-9e9f-47a4-aae9-f105802f1c25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:38.893257 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91dcdac9-9e9f-47a4-aae9-f105802f1c25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:38.894021 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91dcdac9-9e9f-47a4-aae9-f105802f1c25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:38.894484 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91dcdac9-9e9f-47a4-aae9-f105802f1c25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:38.956037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-91dcdac9-9e9f-47a4-aae9-f105802f1c25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:38.963759 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-91dcdac9-9e9f-47a4-aae9-f105802f1c25 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082347 Nov 08 18:12:38.964348 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1381/2760] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:38 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:39.981422 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e60418e0-9059-42ce-968e-bc4f80cf4aeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:39.982053 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e60418e0-9059-42ce-968e-bc4f80cf4aeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:39.988606 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e60418e0-9059-42ce-968e-bc4f80cf4aeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:39.989139 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e60418e0-9059-42ce-968e-bc4f80cf4aeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:39.989918 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e60418e0-9059-42ce-968e-bc4f80cf4aeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:39.990357 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e60418e0-9059-42ce-968e-bc4f80cf4aeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:40.052250 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e60418e0-9059-42ce-968e-bc4f80cf4aeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:40.060824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e60418e0-9059-42ce-968e-bc4f80cf4aeb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.084083 Nov 08 18:12:40.061660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1380/2761] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:39 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:41.077084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-eae39dfb-c98a-4bf4-bce2-14c10f870742 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:41.077730 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-eae39dfb-c98a-4bf4-bce2-14c10f870742 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:41.084134 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eae39dfb-c98a-4bf4-bce2-14c10f870742 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:41.084578 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eae39dfb-c98a-4bf4-bce2-14c10f870742 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:41.085422 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eae39dfb-c98a-4bf4-bce2-14c10f870742 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:41.085852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-eae39dfb-c98a-4bf4-bce2-14c10f870742 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:41.146270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-eae39dfb-c98a-4bf4-bce2-14c10f870742 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:41.154139 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-eae39dfb-c98a-4bf4-bce2-14c10f870742 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080820 Nov 08 18:12:41.154743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1382/2762] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:41 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:42.170647 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f68e8428-bdbe-4ec6-a8cd-83e3f4a6def2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:42.171247 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f68e8428-bdbe-4ec6-a8cd-83e3f4a6def2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:42.177446 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f68e8428-bdbe-4ec6-a8cd-83e3f4a6def2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:42.177898 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f68e8428-bdbe-4ec6-a8cd-83e3f4a6def2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:42.178716 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f68e8428-bdbe-4ec6-a8cd-83e3f4a6def2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:42.179188 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f68e8428-bdbe-4ec6-a8cd-83e3f4a6def2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:42.238157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f68e8428-bdbe-4ec6-a8cd-83e3f4a6def2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:42.246934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f68e8428-bdbe-4ec6-a8cd-83e3f4a6def2 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079993 Nov 08 18:12:42.247462 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1381/2763] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:42 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:43.263053 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7cc614b2-296d-4516-a21c-ed76c4f82059 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:43.263575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-7cc614b2-296d-4516-a21c-ed76c4f82059 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:43.269552 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cc614b2-296d-4516-a21c-ed76c4f82059 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:43.269996 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cc614b2-296d-4516-a21c-ed76c4f82059 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:43.270792 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cc614b2-296d-4516-a21c-ed76c4f82059 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:43.271233 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-7cc614b2-296d-4516-a21c-ed76c4f82059 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:43.329001 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-7cc614b2-296d-4516-a21c-ed76c4f82059 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:43.336575 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7cc614b2-296d-4516-a21c-ed76c4f82059 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077915 Nov 08 18:12:43.337325 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1383/2764] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:43 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:12:44.353417 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c4305b1b-d833-4491-a3ab-9c99e87e40a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:44.354686 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c4305b1b-d833-4491-a3ab-9c99e87e40a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:44.361026 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4305b1b-d833-4491-a3ab-9c99e87e40a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:44.361466 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4305b1b-d833-4491-a3ab-9c99e87e40a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:44.362259 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4305b1b-d833-4491-a3ab-9c99e87e40a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:44.362721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c4305b1b-d833-4491-a3ab-9c99e87e40a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:44.421798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c4305b1b-d833-4491-a3ab-9c99e87e40a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:44.429507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c4305b1b-d833-4491-a3ab-9c99e87e40a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079846 Nov 08 18:12:44.430063 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1382/2765] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:44 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:45.445395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-8344112c-53f1-4074-a730-13baa294e137 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:45.446000 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-8344112c-53f1-4074-a730-13baa294e137 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:45.452449 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8344112c-53f1-4074-a730-13baa294e137 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:45.452888 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8344112c-53f1-4074-a730-13baa294e137 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:45.453645 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8344112c-53f1-4074-a730-13baa294e137 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:45.454074 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-8344112c-53f1-4074-a730-13baa294e137 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:45.515605 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-8344112c-53f1-4074-a730-13baa294e137 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:45.523220 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-8344112c-53f1-4074-a730-13baa294e137 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081466 Nov 08 18:12:45.523784 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1384/2766] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:45 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:46.539503 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-f5e41404-991b-49ba-a168-f5b20dd9ebf1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:46.540130 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-f5e41404-991b-49ba-a168-f5b20dd9ebf1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:46.546388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5e41404-991b-49ba-a168-f5b20dd9ebf1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:46.546853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5e41404-991b-49ba-a168-f5b20dd9ebf1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:46.547617 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5e41404-991b-49ba-a168-f5b20dd9ebf1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:46.548045 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-f5e41404-991b-49ba-a168-f5b20dd9ebf1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:46.606157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-f5e41404-991b-49ba-a168-f5b20dd9ebf1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:46.613742 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-f5e41404-991b-49ba-a168-f5b20dd9ebf1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077857 Nov 08 18:12:46.614290 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1383/2767] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:46 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:47.630499 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-9d716288-9c6e-497b-a6e4-eb1838e51a21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:47.631114 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-9d716288-9c6e-497b-a6e4-eb1838e51a21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:47.638032 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9d716288-9c6e-497b-a6e4-eb1838e51a21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:47.638496 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9d716288-9c6e-497b-a6e4-eb1838e51a21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:47.639270 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9d716288-9c6e-497b-a6e4-eb1838e51a21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:47.856831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-9d716288-9c6e-497b-a6e4-eb1838e51a21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:47.856831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-9d716288-9c6e-497b-a6e4-eb1838e51a21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:47.856831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-9d716288-9c6e-497b-a6e4-eb1838e51a21 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079262 Nov 08 18:12:47.856831 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1385/2768] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:47 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:48.723507 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-1120af38-e463-4f46-8575-54c32f50d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:48.724107 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-1120af38-e463-4f46-8575-54c32f50d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:48.731105 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1120af38-e463-4f46-8575-54c32f50d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:48.731547 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1120af38-e463-4f46-8575-54c32f50d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:48.732790 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1120af38-e463-4f46-8575-54c32f50d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:48.733226 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-1120af38-e463-4f46-8575-54c32f50d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:48.792776 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-1120af38-e463-4f46-8575-54c32f50d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:48.800842 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-1120af38-e463-4f46-8575-54c32f50d508 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081027 Nov 08 18:12:48.801396 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1384/2769] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:48 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:49.817666 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-e7220ae5-1418-43b7-b22b-9001245f5abf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:49.818266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-e7220ae5-1418-43b7-b22b-9001245f5abf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:49.824634 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7220ae5-1418-43b7-b22b-9001245f5abf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:49.825079 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7220ae5-1418-43b7-b22b-9001245f5abf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:49.825840 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7220ae5-1418-43b7-b22b-9001245f5abf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:49.826266 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-e7220ae5-1418-43b7-b22b-9001245f5abf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:49.885454 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-e7220ae5-1418-43b7-b22b-9001245f5abf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:49.893068 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-e7220ae5-1418-43b7-b22b-9001245f5abf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079102 Nov 08 18:12:49.893617 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1386/2770] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:49 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:50.909396 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d0fa8a72-a627-4591-af82-2a619c17e222 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:50.910007 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d0fa8a72-a627-4591-af82-2a619c17e222 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:50.916220 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0fa8a72-a627-4591-af82-2a619c17e222 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:50.916665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0fa8a72-a627-4591-af82-2a619c17e222 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:50.917428 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0fa8a72-a627-4591-af82-2a619c17e222 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:50.917858 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d0fa8a72-a627-4591-af82-2a619c17e222 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:50.976905 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d0fa8a72-a627-4591-af82-2a619c17e222 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:50.984802 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d0fa8a72-a627-4591-af82-2a619c17e222 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079043 Nov 08 18:12:50.985361 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1385/2771] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:50 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:52.001191 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-dcd2bd37-8802-49ca-b6ef-024f1c40d1b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:52.001800 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-dcd2bd37-8802-49ca-b6ef-024f1c40d1b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:52.008035 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcd2bd37-8802-49ca-b6ef-024f1c40d1b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:52.008481 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcd2bd37-8802-49ca-b6ef-024f1c40d1b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:52.009249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcd2bd37-8802-49ca-b6ef-024f1c40d1b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:52.009687 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-dcd2bd37-8802-49ca-b6ef-024f1c40d1b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:52.070430 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-dcd2bd37-8802-49ca-b6ef-024f1c40d1b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:52.078813 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-dcd2bd37-8802-49ca-b6ef-024f1c40d1b4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081623 Nov 08 18:12:52.079379 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1387/2772] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:51 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:53.096388 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-53bd9226-78bf-4840-9ea7-3ad3ee2a8ba1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:53.096989 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-53bd9226-78bf-4840-9ea7-3ad3ee2a8ba1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:53.103110 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53bd9226-78bf-4840-9ea7-3ad3ee2a8ba1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:53.103548 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53bd9226-78bf-4840-9ea7-3ad3ee2a8ba1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:53.104305 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53bd9226-78bf-4840-9ea7-3ad3ee2a8ba1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:53.104735 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-53bd9226-78bf-4840-9ea7-3ad3ee2a8ba1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:53.163739 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-53bd9226-78bf-4840-9ea7-3ad3ee2a8ba1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:53.171550 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-53bd9226-78bf-4840-9ea7-3ad3ee2a8ba1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079117 Nov 08 18:12:53.172104 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1386/2773] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:53 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:12:54.188188 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-906146f9-85c9-4d00-8a1b-6aa3d2081997 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:54.188727 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-906146f9-85c9-4d00-8a1b-6aa3d2081997 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:54.195011 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-906146f9-85c9-4d00-8a1b-6aa3d2081997 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:54.195456 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-906146f9-85c9-4d00-8a1b-6aa3d2081997 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:54.196222 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-906146f9-85c9-4d00-8a1b-6aa3d2081997 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:54.196654 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-906146f9-85c9-4d00-8a1b-6aa3d2081997 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:54.255135 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-906146f9-85c9-4d00-8a1b-6aa3d2081997 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:54.262768 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-906146f9-85c9-4d00-8a1b-6aa3d2081997 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078634 Nov 08 18:12:54.264014 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1388/2774] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:54 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:55.481239 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-def2adff-0ef2-4161-a863-dd20e44ed6a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:55.482398 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-def2adff-0ef2-4161-a863-dd20e44ed6a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:55.488219 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-def2adff-0ef2-4161-a863-dd20e44ed6a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:55.488663 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-def2adff-0ef2-4161-a863-dd20e44ed6a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:55.489434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-def2adff-0ef2-4161-a863-dd20e44ed6a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:55.489870 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-def2adff-0ef2-4161-a863-dd20e44ed6a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:55.548584 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-def2adff-0ef2-4161-a863-dd20e44ed6a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:55.556164 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-def2adff-0ef2-4161-a863-dd20e44ed6a8 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.280909 Nov 08 18:12:55.556717 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1387/2775] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:55 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:56.572816 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-86defa05-4a0b-46b3-8754-5d83cc02b683 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:56.573452 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-86defa05-4a0b-46b3-8754-5d83cc02b683 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:56.580521 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86defa05-4a0b-46b3-8754-5d83cc02b683 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:56.580988 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86defa05-4a0b-46b3-8754-5d83cc02b683 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:56.581743 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86defa05-4a0b-46b3-8754-5d83cc02b683 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:56.582172 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-86defa05-4a0b-46b3-8754-5d83cc02b683 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:56.640704 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-86defa05-4a0b-46b3-8754-5d83cc02b683 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:56.648711 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-86defa05-4a0b-46b3-8754-5d83cc02b683 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079563 Nov 08 18:12:56.649275 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1389/2776] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:56 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:57.665114 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-33a2766a-9fbc-4700-bf8a-78aab992879b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:57.665721 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-33a2766a-9fbc-4700-bf8a-78aab992879b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:57.672589 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33a2766a-9fbc-4700-bf8a-78aab992879b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:57.673036 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33a2766a-9fbc-4700-bf8a-78aab992879b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:57.673798 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33a2766a-9fbc-4700-bf8a-78aab992879b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:57.674236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-33a2766a-9fbc-4700-bf8a-78aab992879b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:57.731307 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-33a2766a-9fbc-4700-bf8a-78aab992879b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:57.739707 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-33a2766a-9fbc-4700-bf8a-78aab992879b tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078263 Nov 08 18:12:57.740255 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1388/2777] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:57 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:58.756005 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-d02298f4-33e7-41e2-907a-45d78d74e6bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:58.756621 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-d02298f4-33e7-41e2-907a-45d78d74e6bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:58.763584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d02298f4-33e7-41e2-907a-45d78d74e6bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:58.764037 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d02298f4-33e7-41e2-907a-45d78d74e6bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:58.764801 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d02298f4-33e7-41e2-907a-45d78d74e6bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:58.765227 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-d02298f4-33e7-41e2-907a-45d78d74e6bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:58.826381 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-d02298f4-33e7-41e2-907a-45d78d74e6bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:58.834151 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-d02298f4-33e7-41e2-907a-45d78d74e6bc tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081828 Nov 08 18:12:58.834748 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1390/2778] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:58 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:12:59.851551 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-cf290c9d-1494-41a1-9325-4ee0b47fb946 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:12:59.852154 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-cf290c9d-1494-41a1-9325-4ee0b47fb946 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:12:59.858979 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cf290c9d-1494-41a1-9325-4ee0b47fb946 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:59.859418 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cf290c9d-1494-41a1-9325-4ee0b47fb946 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:59.860176 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cf290c9d-1494-41a1-9325-4ee0b47fb946 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:12:59.860602 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-cf290c9d-1494-41a1-9325-4ee0b47fb946 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:12:59.917325 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-cf290c9d-1494-41a1-9325-4ee0b47fb946 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:12:59.925571 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-cf290c9d-1494-41a1-9325-4ee0b47fb946 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077648 Nov 08 18:12:59.926128 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1389/2779] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:12:59 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:00.940985 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-f8469e02-3afe-4283-bde6-810cb10b575a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:00.941598 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-f8469e02-3afe-4283-bde6-810cb10b575a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:00.947886 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8469e02-3afe-4283-bde6-810cb10b575a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:00.948332 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8469e02-3afe-4283-bde6-810cb10b575a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:00.949097 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8469e02-3afe-4283-bde6-810cb10b575a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:00.949536 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-f8469e02-3afe-4283-bde6-810cb10b575a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:01.008303 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-f8469e02-3afe-4283-bde6-810cb10b575a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:01.016901 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-f8469e02-3afe-4283-bde6-810cb10b575a tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079594 Nov 08 18:13:01.017467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1391/2780] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:00 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:02.032977 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e5408f3d-fb14-400a-8e22-d5bfd40bd95f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:02.033705 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e5408f3d-fb14-400a-8e22-d5bfd40bd95f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:02.040023 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5408f3d-fb14-400a-8e22-d5bfd40bd95f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:02.040470 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5408f3d-fb14-400a-8e22-d5bfd40bd95f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:02.041233 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5408f3d-fb14-400a-8e22-d5bfd40bd95f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:02.041665 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e5408f3d-fb14-400a-8e22-d5bfd40bd95f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:02.100364 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e5408f3d-fb14-400a-8e22-d5bfd40bd95f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:02.108897 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e5408f3d-fb14-400a-8e22-d5bfd40bd95f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079646 Nov 08 18:13:02.109465 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1390/2781] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:02 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:03.125884 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-328cb170-9ff9-4698-9c06-6bc18124f5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:03.126584 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-328cb170-9ff9-4698-9c06-6bc18124f5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:03.132853 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-328cb170-9ff9-4698-9c06-6bc18124f5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:03.133295 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-328cb170-9ff9-4698-9c06-6bc18124f5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:03.134063 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-328cb170-9ff9-4698-9c06-6bc18124f5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:03.134519 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-328cb170-9ff9-4698-9c06-6bc18124f5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:03.192872 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-328cb170-9ff9-4698-9c06-6bc18124f5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:03.201308 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-328cb170-9ff9-4698-9c06-6bc18124f5be tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078896 Nov 08 18:13:03.201882 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1392/2782] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:03 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:04.218495 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-e2591f65-0c02-488e-b2fc-5998b0a90307 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:04.219136 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-e2591f65-0c02-488e-b2fc-5998b0a90307 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:04.225329 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2591f65-0c02-488e-b2fc-5998b0a90307 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:04.225769 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2591f65-0c02-488e-b2fc-5998b0a90307 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:04.226559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2591f65-0c02-488e-b2fc-5998b0a90307 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:04.226996 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-e2591f65-0c02-488e-b2fc-5998b0a90307 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:04.287273 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-e2591f65-0c02-488e-b2fc-5998b0a90307 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:04.294847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-e2591f65-0c02-488e-b2fc-5998b0a90307 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080888 Nov 08 18:13:04.295409 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1391/2783] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:04 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:05.311651 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-02a997b2-2005-4965-8db3-53d2f4a10477 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:05.312231 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-02a997b2-2005-4965-8db3-53d2f4a10477 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:05.318411 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02a997b2-2005-4965-8db3-53d2f4a10477 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:05.318883 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02a997b2-2005-4965-8db3-53d2f4a10477 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:05.319640 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02a997b2-2005-4965-8db3-53d2f4a10477 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:05.320069 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-02a997b2-2005-4965-8db3-53d2f4a10477 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:05.381448 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-02a997b2-2005-4965-8db3-53d2f4a10477 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:05.389122 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-02a997b2-2005-4965-8db3-53d2f4a10477 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.081664 Nov 08 18:13:05.389684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1393/2784] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:05 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:06.405042 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-d4dcac25-c0c8-4040-90af-0f88d272336f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:06.405660 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-d4dcac25-c0c8-4040-90af-0f88d272336f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:06.411877 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4dcac25-c0c8-4040-90af-0f88d272336f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:06.412326 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4dcac25-c0c8-4040-90af-0f88d272336f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:06.413099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4dcac25-c0c8-4040-90af-0f88d272336f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:06.413538 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-d4dcac25-c0c8-4040-90af-0f88d272336f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:06.472145 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-d4dcac25-c0c8-4040-90af-0f88d272336f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:06.479859 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-d4dcac25-c0c8-4040-90af-0f88d272336f tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078650 Nov 08 18:13:06.480434 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1392/2785] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:06 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:07.496115 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-1f973273-e7d2-40e7-ad86-8c5e75298dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:07.496719 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-1f973273-e7d2-40e7-ad86-8c5e75298dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:07.503653 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f973273-e7d2-40e7-ad86-8c5e75298dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:07.504095 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f973273-e7d2-40e7-ad86-8c5e75298dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:07.504852 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f973273-e7d2-40e7-ad86-8c5e75298dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:07.505283 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-1f973273-e7d2-40e7-ad86-8c5e75298dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:07.564142 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-1f973273-e7d2-40e7-ad86-8c5e75298dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:07.571698 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-1f973273-e7d2-40e7-ad86-8c5e75298dfb tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079231 Nov 08 18:13:07.572249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1394/2786] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:07 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:08.588456 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-ce67bb0c-bb2e-4050-abe9-ea8f487ae8a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:08.589066 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-ce67bb0c-bb2e-4050-abe9-ea8f487ae8a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:08.595432 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce67bb0c-bb2e-4050-abe9-ea8f487ae8a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:08.595875 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce67bb0c-bb2e-4050-abe9-ea8f487ae8a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:08.596637 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce67bb0c-bb2e-4050-abe9-ea8f487ae8a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:08.597068 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-ce67bb0c-bb2e-4050-abe9-ea8f487ae8a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:08.654653 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-ce67bb0c-bb2e-4050-abe9-ea8f487ae8a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:08.662151 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-ce67bb0c-bb2e-4050-abe9-ea8f487ae8a1 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.077346 Nov 08 18:13:08.662729 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1393/2787] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:08 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:09.678277 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-91be7296-4b32-40b6-a376-3878f79a1420 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:09.678913 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-91be7296-4b32-40b6-a376-3878f79a1420 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:09.685269 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91be7296-4b32-40b6-a376-3878f79a1420 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:09.685708 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91be7296-4b32-40b6-a376-3878f79a1420 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:09.686535 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91be7296-4b32-40b6-a376-3878f79a1420 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:09.686919 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-91be7296-4b32-40b6-a376-3878f79a1420 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:09.745300 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-91be7296-4b32-40b6-a376-3878f79a1420 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:09.753663 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-91be7296-4b32-40b6-a376-3878f79a1420 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.078555 Nov 08 18:13:09.760426 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1395/2788] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:09 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:10.770430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-c66a4202-3547-411a-9c8d-cae496079629 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:10.771075 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-c66a4202-3547-411a-9c8d-cae496079629 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:10.777365 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c66a4202-3547-411a-9c8d-cae496079629 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:10.777824 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c66a4202-3547-411a-9c8d-cae496079629 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:10.778640 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c66a4202-3547-411a-9c8d-cae496079629 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:10.779108 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-c66a4202-3547-411a-9c8d-cae496079629 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:10.837400 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-c66a4202-3547-411a-9c8d-cae496079629 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:10.845953 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-c66a4202-3547-411a-9c8d-cae496079629 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.079279 Nov 08 18:13:10.846541 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1394/2789] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:10 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:11.863865 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-42ee581c-7ac0-47ed-8052-12b0886bcec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:11.864803 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-42ee581c-7ac0-47ed-8052-12b0886bcec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:11.871444 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42ee581c-7ac0-47ed-8052-12b0886bcec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:11.872624 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42ee581c-7ac0-47ed-8052-12b0886bcec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:11.873779 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42ee581c-7ac0-47ed-8052-12b0886bcec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:11.874298 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-42ee581c-7ac0-47ed-8052-12b0886bcec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:11.935780 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-42ee581c-7ac0-47ed-8052-12b0886bcec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:11.943498 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-42ee581c-7ac0-47ed-8052-12b0886bcec4 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.083935 Nov 08 18:13:11.944059 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1396/2790] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:11 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:12.991109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-75e95a16-ea49-4e90-b53c-6de12b081b69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:12.991109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-75e95a16-ea49-4e90-b53c-6de12b081b69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:12.991109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75e95a16-ea49-4e90-b53c-6de12b081b69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:12.991109 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75e95a16-ea49-4e90-b53c-6de12b081b69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:12.991725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75e95a16-ea49-4e90-b53c-6de12b081b69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:12.991725 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-75e95a16-ea49-4e90-b53c-6de12b081b69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:13.030029 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-75e95a16-ea49-4e90-b53c-6de12b081b69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:13.037771 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-75e95a16-ea49-4e90-b53c-6de12b081b69 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.080873 Nov 08 18:13:13.038407 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1395/2791] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:12 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:14.056070 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-83182260-b786-458d-b73f-ee3cc89157cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:14.056684 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-83182260-b786-458d-b73f-ee3cc89157cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:14.063182 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83182260-b786-458d-b73f-ee3cc89157cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:14.063627 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83182260-b786-458d-b73f-ee3cc89157cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:14.064395 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83182260-b786-458d-b73f-ee3cc89157cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:14.064827 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-83182260-b786-458d-b73f-ee3cc89157cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:14.127201 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.policy [None req-83182260-b786-458d-b73f-ee3cc89157cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127762) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:14.135681 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-83182260-b786-458d-b73f-ee3cc89157cf tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.083091 Nov 08 18:13:14.145610 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1397/2792] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:14 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:15.152511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-efdfc85e-8805-4a74-9817-a788bbdcbe29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:15.153613 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-efdfc85e-8805-4a74-9817-a788bbdcbe29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:15.160593 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-efdfc85e-8805-4a74-9817-a788bbdcbe29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:15.163430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-efdfc85e-8805-4a74-9817-a788bbdcbe29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:15.163430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-efdfc85e-8805-4a74-9817-a788bbdcbe29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:15.163430 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-efdfc85e-8805-4a74-9817-a788bbdcbe29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:15.230111 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-efdfc85e-8805-4a74-9817-a788bbdcbe29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:15.239356 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-efdfc85e-8805-4a74-9817-a788bbdcbe29 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.090516 Nov 08 18:13:15.239932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1396/2793] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:15 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:15.717690 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [req-b6909dd7-36ac-47c8-b9fb-0b946ed9b22c req-1ee2a62b-5500-46b4-850a-8e7f21a8b98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6c9295-0da3-43bd-b2fa-5709f1c39dbe", "name": "network-vif-deleted", "tag": "a97c62f3-4ad6-47b6-ab5e-55e6bae21f78"}]} {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 08 18:13:15.719868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 08 18:13:15.719868 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: warnings.warn(msg) Nov 08 18:13:15.727239 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-b6909dd7-36ac-47c8-b9fb-0b946ed9b22c req-1ee2a62b-5500-46b4-850a-8e7f21a8b98e service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:15.727676 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [req-b6909dd7-36ac-47c8-b9fb-0b946ed9b22c req-1ee2a62b-5500-46b4-850a-8e7f21a8b98e service nova] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:15.741322 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.compute.server_external_events [req-b6909dd7-36ac-47c8-b9fb-0b946ed9b22c req-1ee2a62b-5500-46b4-850a-8e7f21a8b98e service nova] Creating event network-vif-deleted:a97c62f3-4ad6-47b6-ab5e-55e6bae21f78 for instance 6e6c9295-0da3-43bd-b2fa-5709f1c39dbe on hv-cinder-81689 Nov 08 18:13:15.745661 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: ERROR oslo.messaging._drivers.impl_rabbit [req-b6909dd7-36ac-47c8-b9fb-0b946ed9b22c req-1ee2a62b-5500-46b4-850a-8e7f21a8b98e service nova] [8b8a761b-b175-42bc-b483-2d3f163b9e19] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 08 18:13:16.257448 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-04f73925-140a-49f9-bb2a-519b81d233c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:16.258050 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-04f73925-140a-49f9-bb2a-519b81d233c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:16.264896 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04f73925-140a-49f9-bb2a-519b81d233c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:16.265411 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04f73925-140a-49f9-bb2a-519b81d233c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:16.266197 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04f73925-140a-49f9-bb2a-519b81d233c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:16.266681 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-04f73925-140a-49f9-bb2a-519b81d233c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:16.327694 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-04f73925-140a-49f9-bb2a-519b81d233c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:16.335933 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-04f73925-140a-49f9-bb2a-519b81d233c3 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1353 microversion: 2.1 time: 0.082324 Nov 08 18:13:16.336536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1397/2794] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:16 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:13:16.765467 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [req-b6909dd7-36ac-47c8-b9fb-0b946ed9b22c req-1ee2a62b-5500-46b4-850a-8e7f21a8b98e service nova] [8b8a761b-b175-42bc-b483-2d3f163b9e19] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 60452. Nov 08 18:13:16.770240 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [req-b6909dd7-36ac-47c8-b9fb-0b946ed9b22c req-1ee2a62b-5500-46b4-850a-8e7f21a8b98e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.058746 Nov 08 18:13:16.771041 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1398/2795] 10.222.0.18 () {64 vars in 1317 bytes} [Mon Nov 8 18:13:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:13:17.352982 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:17.353559 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.compute.api [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127763) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:17.359932 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:17.360472 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:17.361295 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:17.361731 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:17.404157 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:17.405150 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG oslo_concurrency.lockutils [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:17.405847 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.objects.instance [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lazy-loading 'fault' on Instance uuid 76806517-5f8b-4d47-89f6-66e876baa194 {{(pid=127763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 08 18:13:17.446492 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.policy [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828709bcff1644db887985ded838db9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50aa3caf30d841ae976d8ddb86d00a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127763) authorize /opt/stack/nova/nova/policy.py:199}} Nov 08 18:13:17.454051 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-aa49d271-a271-48e0-89c5-81a8ea3dd409 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 200 len: 1312 microversion: 2.1 time: 0.104708 Nov 08 18:13:17.454672 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1398/2796] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:17 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 08 18:13:18.473098 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Calling method '>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:18.473790 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.compute.api [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] [instance: 76806517-5f8b-4d47-89f6-66e876baa194] Fetching instance by UUID {{(pid=127762) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 08 18:13:18.479804 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:18.480250 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:18.481007 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 08 18:13:18.481437 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG oslo_concurrency.lockutils [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Lock "1542ebd2-db84-411d-aeb4-4e8d8b32d2fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 08 18:13:18.494385 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.wsgi [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] HTTP exception thrown: Instance 76806517-5f8b-4d47-89f6-66e876baa194 could not be found. Nov 08 18:13:18.494982 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] Returning 404 to user: Instance 76806517-5f8b-4d47-89f6-66e876baa194 could not be found. {{(pid=127762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 08 18:13:18.495781 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a51ce26b-0118-481b-8ef3-ab8e1ec161a7 tempest-ServerRescueNegativeTestJSON-1762930645 tempest-ServerRescueNegativeTestJSON-1762930645-project] 10.222.0.18 "GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194" status: 404 len: 111 microversion: 2.1 time: 0.028405 Nov 08 18:13:18.496304 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1399/2797] 10.222.0.18 () {58 vars in 1235 bytes} [Mon Nov 8 18:13:18 2021] GET /compute/v2.1/servers/76806517-5f8b-4d47-89f6-66e876baa194 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 08 18:13:25.648236 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-4e300c43-acaa-40a1-aa98-83003210bd1c tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06f060d940>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:25.698379 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-4e300c43-acaa-40a1-aa98-83003210bd1c tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/87305d55-186b-404a-b941-72ac27bf5348" status: 200 len: 351 microversion: 2.1 time: 0.057979 Nov 08 18:13:25.698986 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1399/2798] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 18:13:25 2021] GET /compute/v2.1/os-volumes/87305d55-186b-404a-b941-72ac27bf5348 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:13:27.325787 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-7a38bb81-9f8b-4396-ae8b-786ca14109f0 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06ec24a790>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:27.374249 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-7a38bb81-9f8b-4396-ae8b-786ca14109f0 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/961d8d56-0eb3-4ee0-aed9-118bde2e9b63" status: 200 len: 350 microversion: 2.1 time: 0.052362 Nov 08 18:13:27.375475 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1400/2799] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 18:13:27 2021] GET /compute/v2.1/os-volumes/961d8d56-0eb3-4ee0-aed9-118bde2e9b63 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:13:32.223346 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-01cee773-9846-46b3-9414-037232e7b7ea tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06ec1b53a0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:32.270321 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-01cee773-9846-46b3-9414-037232e7b7ea tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/c52901a2-7bb8-4fab-8b5b-f6864bd7f49d" status: 200 len: 351 microversion: 2.1 time: 0.051633 Nov 08 18:13:32.270948 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1400/2800] 10.222.0.18 () {58 vars in 1244 bytes} [Mon Nov 8 18:13:32 2021] GET /compute/v2.1/os-volumes/c52901a2-7bb8-4fab-8b5b-f6864bd7f49d => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:13:32.282788 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-a3b93770-9678-46c5-a990-05002f90df9f tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06ec397550>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:32.544656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-a3b93770-9678-46c5-a990-05002f90df9f tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.266412 Nov 08 18:13:32.545224 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1401/2801] 10.222.0.18 () {58 vars in 1133 bytes} [Mon Nov 8 18:13:32 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:32.558175 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-8a1f64bb-154f-4280-a30d-232537059692 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06ec23f9d0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:32.683118 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-8a1f64bb-154f-4280-a30d-232537059692 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.129244 Nov 08 18:13:32.684279 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1401/2802] 10.222.0.18 () {58 vars in 1148 bytes} [Mon Nov 8 18:13:32 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:13:32.695531 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4c5d8200-ba95-4af9-9e0a-3cf7a2a2988c tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06ec397310>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:32.788494 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4c5d8200-ba95-4af9-9e0a-3cf7a2a2988c tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096795 Nov 08 18:13:32.789071 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1402/2803] 10.222.0.18 () {58 vars in 1133 bytes} [Mon Nov 8 18:13:32 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:32.800591 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-b2678095-e189-4abb-956f-c3b06a2e8ab3 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06f0679160>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:32.879536 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-b2678095-e189-4abb-956f-c3b06a2e8ab3 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083107 Nov 08 18:13:32.880099 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1402/2804] 10.222.0.18 () {58 vars in 1166 bytes} [Mon Nov 8 18:13:32 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:13:32.891707 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-4b9c7b68-c8ee-4b16-ae6e-ca851ba84dd1 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06ec24a9d0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:32.969696 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-4b9c7b68-c8ee-4b16-ae6e-ca851ba84dd1 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081143 Nov 08 18:13:32.970656 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1403/2805] 10.222.0.18 () {58 vars in 1169 bytes} [Mon Nov 8 18:13:32 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:13:32.982934 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3df175e9-c6bb-42a4-acf2-49ff439d2ca3 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06f060d1f0>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:33.065330 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3df175e9-c6bb-42a4-acf2-49ff439d2ca3 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086207 Nov 08 18:13:33.065923 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1403/2806] 10.222.0.18 () {58 vars in 1154 bytes} [Mon Nov 8 18:13:32 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:33.076767 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: DEBUG nova.api.openstack.wsgi [None req-b82c8358-06f7-4d07-861e-17b70fc51dcc tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06ec2133a0>' {{(pid=127762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:33.323223 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO nova.api.openstack.requestlog [None req-b82c8358-06f7-4d07-861e-17b70fc51dcc tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.249924 Nov 08 18:13:33.323807 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: [pid: 127762|app: 0|req: 1404/2807] 10.222.0.18 () {58 vars in 1187 bytes} [Mon Nov 8 18:13:33 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 08 18:13:33.336600 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: DEBUG nova.api.openstack.wsgi [None req-3c1924c6-31f1-46c4-ac0c-bc64ddd77b52 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] Calling method '.version_select at 0x7f06ec26ee50>' {{(pid=127763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 08 18:13:33.417690 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO nova.api.openstack.requestlog [None req-3c1924c6-31f1-46c4-ac0c-bc64ddd77b52 tempest-VolumesTestJSON-693500301 tempest-VolumesTestJSON-693500301-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085269 Nov 08 18:13:33.418261 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: [pid: 127763|app: 0|req: 1404/2808] 10.222.0.18 () {58 vars in 1154 bytes} [Mon Nov 8 18:13:33 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 08 18:13:49.599033 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:13:49.599523 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:13:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:13:50.567511 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:13:50.567945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:13:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:13:55.154600 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:13:55.155106 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:13:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:14:26.046853 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:14:26.047331 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:14:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:14:52.369266 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:14:52.369945 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:14:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:17:09.616632 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:17:09.617084 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:17:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:17:10.585117 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:17:10.585585 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:17:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:17:15.173054 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:17:15.173546 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:17:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:17:46.065057 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:17:46.065516 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:17:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:18:12.386648 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:18:12.387311 dv-cinder-816898-2-iscsi devstack@n-api.service[127763]: Mon Nov 8 18:18:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 08 18:19:16.432644 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 08 18:19:16.433184 dv-cinder-816898-2-iscsi devstack@n-api.service[127762]: Mon Nov 8 18:19:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!